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Abstract 


As  costs  rise  in  general  aviation,  many  prTvate  pilots  are  forced  to  reduce  the  rates 
at  which  they  fly,  both  during  training  and  after  certification,  in  order  to  spread 
out  expenses.  This  report  describes  the  results  of  the  first  phase  of  a  two  and  one- 
half  year  study  designed  to  study  the  impact  on  pilot  performance  of  reductions  in  th« 
rates  at  which  student  and  private  pilots  fly.  The  major  objective  of  the  first  phase 
of  the  study  was  to  determine  the  impact  of  different  rates  of  flying  during  private 
pilot  training  on  the  effectiveness  and  efficiency  of  instruction.  The  second  phase 
of  the  study,  which  was  still  in  progress  when  this  report  was  written,  will  assess 
the  impact  of  differences  in  the  rates  of  flying  before  and  after  certification  on 
the  retention  of  flight  skills  after  certification. 

In  general,  it  was  found  that  different  rates  of  flying  during  training  had  no  signi¬ 
ficant  influence  on  overall  instructional  effectiveness.  The  different  rates  did 
have  a  significant,  practical  impact  on  instructional  efficiency.  Students  whose 
flying  was  spread  out  more  (l.e.,  distributed)  tended  to  fly  fewer  flight  hours, 
particularly  dual  hours  with  their  instructors,  than  students  whose  training  was  more 
concentrated.  In  response  to  questions  on  an  opinion  survey,  students  in  the  concen¬ 
trated  flying  program  indicated  that  they  felt  their  training  was  more  harried  and 
that  it  distracted  them  more  from  their  jobs.  They  were  also  less  confident  and  less 
positive  toward  their  flight  training. 
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EXECUTIVE  SUMMARY 


BACKGROUND. 

As  with  costs  In  other  sections  of  the  American  economy,  the  expen 
dated  with  owning  and  operating  general  aviation  aircraft  are  rising  rapidly. 
One  segment  of  the  general  aviation  pilot  community  that  Is  hit  particularly 
hard  by  cost  Increases  are  private  pilots  vrtio  fly  for  recreational  purposes 
and  as  a  preferred  method  of  travel  for  their  own  business  and  personal  rea¬ 
sons.  As  costs  rise,  many  of  these  pilots  are  forced  to  fly  less  frequently 
In  order  to  spread  their  expenses  over  a  longer  period.  Such  reductions  In 
the  rate  at  which  they  fly  may  occur  both  during  training  for  private  pilot 
certificates,  especially  since  Instructional  costs  are  added  to  other 
expenses,  as  well  as  after  certification. 

V  The  possible  Impacts  of  such  reductions  In  flying  time  on  private  pilot 
training  and  on  the  proficiency  of  private  pilots  In  the  years  following  cer¬ 
tification  are  unknown.  Limited  Information  currently  exists  concerning  the 
Influence  of  different  distributions  of  training  time  on  the  effectiveness  and 
efficiency  of  private  pilot  Instruction.  Similarly,  little  Information  exists 
concerning  how  different  rates  of  flying  affect  the  retention  of  critical  fly¬ 
ing  skills  required  of  private  pilots  to  exercise  the  privileges  of  their  cer¬ 
tificates.  Such  Information  could  aid  in  the  development  of  efficient  and 
effective  pilot  training/retraining  programs  and  of  procedures  for  their 
associated  reviews  of  pilot  proficiency. 

OBJECTIVES. 

In  recognition  of  the  need  for  this  information,  the  Federal  Aviation 
Administration  (FAA)  Technical  Center  has  Initiated  a  two  and  one-half  year 
study  to  Investigate  the  Impact  of  different  rates  of  flying  on  pilot  training 
and  the  proficiency  of  certificated  pilots.  This  report  describes  the  results 
of  the  first  phase,  approximately  the  first  nine  months,  of  this  project.  The 
second  phase,  which  was  In  progress  at  the  time  this  report  was  written,  will 
be  reported  later. 

This  Initial  phase  of  the  study  had  two  major  objectives.  The  first  was  to 
determine  If  different  distributions  of  training  time,  l.e.,  the  rates  at 
which  pilots  fly  and  attend  ground  school,  have  an  Impact  on  (1)  the  final 
level  of  proficiency  attained  by  student  pilots  at  the  end  of  their  training; 
and  (2)  the  efficiency  of  instruction.  The  second  major  objective  was  to 
develop  a  data  base  describing  the  level  of  flying  skill  attained  by  Individ¬ 
ual  pilots  at  the  end  of  their  training.  This  data  base  will  be  used  In  the 
second  phase  of  the  study  as  a  standard  of  comparison—  1  .e.,  a  baseline— for 
analyzing  the  retention  of  flying  skills  by  these  pilots  In  the  two-year 
period  following  their  certification.  In  addition  to  these  major  objectives, 
the  first  phase  also  had  a  secondary  objective,  l.e.,  to  determine  the  ability 
of  pilots  to  assess  the  adequacy  of  their  own  flying  skills.  This  objective 
was  included  to  lay  the  foundation  for  subsequent  analyses  In  the  second  phase 
which  will  be  devoted  to  gaining  a  better  understanding  of  the  ability  of  pri¬ 
vate  pilots  to  determine  their  own  training  needs,  l.e.,  to  determine  when 


they  need  to  practice  a  given  flight  task  In  order  to  retain  or  regain  their 
proficiency  on  that  task. 

METHOD. 


The  study  Is  being  carried  out  at  the  FAA  Technical  Center  In  Atlantic  City, 
New  Jersey.  During  the  first  study  phase  reported  here,  two  groups  of  student 
pilots  were  trained  using  programs  that  differed  only  In  the  frequency  with 
which  flight  lessons  and  ground  school  sessions  were  scheduled.  These  fre¬ 
quencies  were  selected  so  as  to  result  In  one  program  that  lasted  approxi¬ 
mately  three  months  (Program  A)  and  another  that  lasted  approximately  six 
months  (Program  B) .  A  total  of  58  student  pilots,  all  without  previous  flight 
experience,  served  as  subjects  In  the  study.  Of  these,  42  completed  training 
(24  in  Program  A  and  18  In  Program  B) . 

Four  flight  tests  were  administered  during  the  training  program,  one  at  the 
end  of  each  main  phase  of  flight  training  (l.e..  Presolo;  Basic  Pilot  Opera¬ 
tions;  Cross-Country  Flight  Operations;  and  Preparation  for  the  Private  Pilot 
Flight  Test).  These  flight  tests  were  scored  using  the  Pilot  Performance 
Description  Record  (PPDR),  an  objective  performance  measurement  Instrument 
that  enables  an  accurate,  detailed  description  of  pilot  performance  to  be 
recorded.  The  PPDR  was  divided  Into  three  task  subsets— I,  II,  and  III. 
Subset  I  contained  tasks  concerned  with  basic  flight  operations,  e.g.,  normal 
takeoffs  and  landings,  while  Subset  II  contained  tasks  concerned  with  advanced 
flight  maneuvers,  e.g.,  accelerated  stalls,  maximum  performance  takeoffs. 
Subset  III  contained  tasks  Involved  In  cross-country  flights.  The  first 
flight  test  was  scored  using  only  Task  Subset  I.  The  second  one  was  scored 
using  both  Subsets  I  and  II.  Finally,  the  third  and  fourth  checkrldes  were 
scored  using  all  three  subsets— I,  II,  and  III. 

In  addition  to  the  PPDR,  five  other  measures  were  developed  specifically  for 
use  In  the  present  study. 

(1)  A  series  of  six  written  quizzes  developed  by  E-RAU  personnel  and 
administered  periodically  during  the  ground  school. 

(2)  A  final  exam  also  developed  by  E-RAU  personnel  and  administered  at 
the  end  of  ground  school . 

(3)  A  questionnaire  that  assessed  the  ability  of  students  to  predict 
how  well  they  would  perform  on  the  fourth  checkrlde. 

(4)  A  questionnaire  that  assessed  the  ability  of  students  to  evaluate 
their  performance  on  the  fourth  checkrlde  after  they  had  completed  It. 

(5)  A  Student  Opinion  Survey  designed  to  assess  student  reaction  to  the 
training  program  and  flying  In  general. 

Further,  the  following  data  were  also  collected. 

(1)  Scores  on  the  FAA  private  pllot-airpl ane  written  test. 

(2)  Scores  on  the  FAA  private  pllot-airpl  ane  flight  test. 


(3)  Number  of  flight  hours  and  other  Instructor-contact  hours  accumu¬ 
lated  by  the  students  during  flight  training. 

The  data  described  above  were  used  in  the  first  phase  of  the  study  to  analyze 
the  Impact  of  different  distributions  of  training  time  on  the  efficiency  and 
effectiveness  of  Instruction.  During  the  second  phase  of  the  study,  similar 
data  will  be  obtained  at  eight-month  intervals  over  a  two-year  period.  The 
second  phase  results,  together  with  those  of  the  first  phase,  will  be  used  to 
assess  the  Impact  of  different  rates  of  flying,  both  before  and  after 
certification,  on  the  retention  of  flying  skills. 

RESULTS. 

The  results  of  the  experiment  can  be  discussed  under  four  major  categories  of 
findings:  (1)  training  effectiveness;  (2)  training  efficiency;  (3)  assessment 
of  own  performance;  and  (4)  perception  of  training.  Table  12  In  Section  IV 
summarizes  the  findings  with  respect  to  each  of  the  measures  employed  In  the 
study. 

TRAINING  EFFECTIVENESS.  In  general,  with  respect  to  the  overal  1  performance 
of  the  students  at  the  end  of  ground  and  flight  training,  there  were  no  signi¬ 
ficant  differences  between  Programs  A  and  B.  When  performance  was  considered 
with  respect  to  the  separate  PPDR  Task  Subsets  (I,  II,  and  III)  on  the  fourth 
checkrlde,  however,  certain  patterns  of  differences  did  appear.  Students  In 
Program  B  made  fewer  errors  on  tasks  in  Subsets  I  and  II,  while  students  In 
Program  A  tended  to  make  fewer  errors  on  tasks  In  Subset  III. 

TRAINING  EFFICIENCY.  Training  efficiency  was  assessed  In  three  ways:  (1)  the 
number  of  lUght  hours;  (2)  the  patterns  of  student  progress  through  flight 
training  as  measured  on  the  four  checkrldes;  and  (3)  the  patterns  of  progress 
of  the  students  through  ground  school  as  measured  on  the  six  written  quizzes. 

Students  In  Program  B  received  fewer  total  flight  hours  during  their  training 
than  did  students  In  Program  A.  This  difference  In  total  time  was  entirely 
due  to  a  substantial  difference  In  dual  flight  time;  there  was  no  such  dif¬ 
ference  In  solo  flight  time.  0thefr"sTgn1f  leant  differences  In  flight  time, 
when  they  occurred,  also  favored  Program  B— i.e.,  students  In  Program  B  flew 
fewer  hours  prior  to  Checkrldes  3  and  4. 

The  pattern  of  Program  B  tending  to  be  more  efficient  Is  also  apparent  In 
measures  of  the  progress  of  the  students  through  the  flight  training  programs, 
I.e.,  In  the  patterns  of  the  PPDR  scores  obtained  on  the  four  checkrldes. 
When  significant  differences  were  observed,  they  were  almost  always  In  favor 
of  Program  B.  Performance  of  tasks  In  Subset  II,  for  example,  was  better  for 
Program  B  on  all  three  checkrldes  (2,  3,  and  4)  on  which  this  subset  was 
measured.  This  superiority  Is  Illustrated  In  Figure  6  In  Section  III.  Thus, 
students  In  Program  B  tended  to  fly  less,  at  least  with  their  Instructors,  and 
tended  to  perform  better  at  various  flight  checkpoints  during  the  program. 

The  relative  efficiency  advantage  of  Program  B  over  A  held  true  only  for 
flight  training,  however.  When  the  pattern  of  academic  performance  on  the  six 
written  quizzes  during  ground  school  was  examined,  It  revealed  that  students 
In  Program  A  scored  higher  than  those  In  Program  B  on  all  quizzes,  especially 
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the  last  three.  Nevertheless,  the  Program  B  students  did  catch  up  by  the  end 
of  the  ground  school  with  the  result  that  there  was  no  difference  between 
groups  on  the  two  end-of-course  written  tests. 

ASSESSMENT  OF  PERFORMANCE .  Using  the  preflight  questionnaires  employed  In 
tM s  study ,  the  students,  taken  as  a  group,  were  not  able  to  predict  the 
number  of  errors  they  would  make  on  the  fourth  checkrlde;  nor  were  they  able 
to  evaluate  their  own  performance  accurately  after  they  had  completed  the 
fourth  checkrlde.  Some  students,  however,  were  better  than  others  at  pre¬ 
dicting  and  evaluating  their  performance.  Unfortunately,  there  was  no  way  to 
Identify  beforehand  which  students  would  be  better  able  to  predict  and 
evaluate  their  own  performance. 

PERCEPTION  OF  TRAINING.  Based  on  their  general  response  to  the  Student 
Opinion  Survey,  the  students  In  both  programs  felt  very  positive  toward  their 
flight  training,  with  those  In  Program  B  being  slightly  more  positive  than 
those  In  Program  A.  With  respect  to  specific  survey  questions,  only  a  few 
differences  occurred  between  the  responses  of  students  In  the  two  programs. 
Students  In  Program  A  felt  that  their  flight  training  was  more  harried  and 
that  It  distracted  them  more  from  their  job.  They  also  reported  more  diffi¬ 
culty  In  remembering  vrtiat  was  learned.  Students  In  Program  B  would  have  pre¬ 
ferred  more  frequent  flight  lessons.  Finally,  using  measures  on  the  Student 
Opinion  Survey  and  the  pre-  and  post-flight  questionnaires.  It  was  observed 
that  students  In  Program  B  were  more  confident  In  their  flight  training  than 
those  In  Program  A. 

CONCLUSIONS. 

In  general,  these  data  suggest  that  the  lengthening  of  private  pilot  training 
to  spread  out  training  expenses  as  these  costs  rise  will  not  have  a  serious 
Impact  on  the  effectiveness  of  Instruction,  at  least  with  respect  to  perfor¬ 
mance  at  the  end  of  Instruction.  Insofar  as  the  Phase  I  results  are  con¬ 
cerned,  there  were  no  practical,  comprehensive  differences  In  Instructional 
effectiveness  between  the  two  programs. 

Whether  training  Is  distributed  or  concentrated  does  appear  to  have  an  Impact 
on  Instructional  efficiency.  Students  in  the  longer  program  flew  fewer  flight 
hours,  particularly  dual  flight  hours,  than  did  those  in  the  shorter  program. 
Given  the  costs  (and  fuel  consumption)  associated  with  flight  hours,  espe¬ 
cially  dual  hours,  this  finding  Is  of  substantial  practical  Importance. 

The  Increased  efficiency  of  the  longer  program  Is  also  reflected  In  the  pat¬ 
terns  of  student  progress  through  flight  training.  When  differences  existed, 
students  In  the  longer  program  tended  to  perform  better  on  the  four  checkrldes 
administered  periodically  during  training.  A  different  trend  appeared, 
however,  when  patterns  of  student  progress  through  ground  school  training  were 
assessed.  In  this  case,  students  In  the  shorter  program  did  better  on  the 
periodic  written  quizzes  given  during  ground  training.  Thus,  It  would  be 
beneficial  to  schedule  ground  and  flight  training  segments  at  different  rates 
to  take  advantage  of  positive  aspects  of  concentrated  and  distributed 
training. 
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In  agreement  with  observed  differences  on  training  efficiency,  certain  pat¬ 
terns  appeared  In  the  way  students  perceived  their  training.  Students  In  the 
longer  program  felt  slightly  more  positive  toward  their  flight  training, 
although  they  preferred  to  have  flown  more  frequently.  Students  in  the 
shorter  program  felt  their  flight  training  was  more  harried  and  that  It 
distracted  them  more  from  their  job.  Additionally,  students  In  the  shorter 
program  appeared  to  be  less  confident  In  their  training  than  those  In  the 
longer  program. 
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PREFACE 


This  report  describes  the  results  of  the  first  phase  of  a  study  of  the  Impact 
on  pilot  performance  of  the  rates  at  which  student  and  private  pilots  fly, 
l.e.,  In  the  manner  In  which  their  flying  Is  distributed  over  calendar  time. 
Reductions  In  rates  of  flying  are  projected  due  to  increased  aircraft  opera¬ 
ting  costs,  possible  fuel  shortages,  and  other  factors  making  it  expensive  and 
difficult  for  these  pilots  to  fly.  The  overall  study  investigating  such 
effects  will  require  two  and  one-half  years  to  complete.  The  first  phase  of 
the  effort  reported  here  required  approximately  nine  months  to  complete.  The 
major  goal  of  the  first  phase  of  the  study  was  to  determine  the  effects  of 
different  distributions  of  flight  time  durl ng  private  pilot  training— 1  .e., 
differences  In  the  rates  at  which  flight  lessons  are  scheduled— on  the  effi¬ 
ciency  and  effectiveness  of  the  Instruction.  The  second  phase  of  the  study, 
still  In  progress  at  the  time  this  report  was  written,  will  Investigate  the 
effects  of  different  distributions  of  flight  time,  both  before  and  after 
certification,  on  the  retention  of  private  pilot  flying  skilTTI 

Both  phases  of  this  effort,  along  with  several  other  projects,  are  part  of  an 
ongoing  task  order  research  program  sponsored  by  the  Federal  Aviation  Adminis¬ 
tration  (FAA)  Technical  Center  (Contract  Number  D0T-FA79NA-6040) .  This 

research  program  is  devoted  to  the  Identification  and  solution  of  human  fac¬ 
tors  problems  In  general  aviation.  Work  on  this  program  Is  being  performed 
jointly  by  the  Embry-Rlddle  Aeronautical  University  (E-RAU)  Research  Center, 
asgrlme  contractor,  and  the  Seville  Research  Corporation,  under  subcontract 
ifiJT-RAU.  With  respect  to  the  research  reported  here,  Seville  was  responsible 
for  design  of  the  study,  analysis  of  the  data,  and  preparation  of  this  report. 
E-RAU  was  responsible  for  development  of  the  flight  program,  training  of  stu¬ 
dents,  collection  of  the  data,  and  provision  of  training  equipment,  Instruc¬ 
tors,  and  support  personnel . 

Dr.  Jerome  I.  Berlin,  Director  of  the  E-RAU  Research  Center,  Is  Program 

Manager  for  the  prime  contract.  Dr.  Wallace  W.  Prophet  served  as  Sev4lle's 
Program  Manager  for  this  effort,  and  Dr.  Jack  B.  Shelnutt  as  Project  Director. 
Dr.  William  D.  Spears  of  Seville  was  responsible  for  much  of  the  data  analy¬ 
sis.  Dr.  Jerry  M.  Childs  and  Mr.  Edward  Miller  of  Seville  aided  In  the  devel¬ 
opment  of  the  pilot  performance  measurement  Instruments.  Mr.  E.  Peter  Denlea, 

Associate  Director  of  the  E-RAU  Research  Center,  coordinated  all  research 

activities  and  provided  overall  management  of  training  and  data  collection. 
Supervision  of  flight  training  and  data  quality  control  assistance  were  pro¬ 
vided  by  Mr.  Douglas  Berchem  of  the  E-RAU  Research  Center.  Data  were  col¬ 
lected  by  Mr.  Ray  Rutt,  Mr.  Tony  Frock,  Mr.  Michael  Sperry,  and  Mr.  Tad  McGee 

of  E-RAU.  The  Contracting  Officer's  Technical  Representative  for  the  FAA 
Technical  Center  was  Mr.  Oouglas  Harvey. 
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I.  INTRODUCTION 


BACKGROUND. 

As  with  costs  In  other  sections  of  the  American  economy,  the  expenses  asso¬ 
ciated  with  owning  and  operating  general  aviation  aircraft  are  rising  rapidly. 
This  cost  escalation  in  general  aviation  is  attributable  to  several  sources— 
increases  In  fuel  costs;  higher  purchase  prices  for  aircraft  and  avionics; 
increasing  interest  rates  for  financing  purchases;  rising  maintenance  costs; 
Increases  in  various  aviation- related  taxes  and  fees;  and  the  rise,  due  to 
general  Inflation,  of  a  host  of  other  expenses  faced  by  general  aviation 
aircraft  owners  and  pilots.  For  general  aviation  to  continue  to  grow  In 
Importance  to  American  society,  It  must  meet  the  substantial  challenges  posed 
by  these  rising  costs. 

One  segment  of  the  general  aviation  pilot  community  that  is  hit  particularly 
hard  by  such  costs  are  private  pilots  who  fly  for  recreational  purposes  and  as 
a  preferred  method  of  travel  for  their  own  business  and  personal  reasons. 
They  are  not  full-time,  professional  pilots,  but  rather  earn  their  Income  In 
other  ways  and,  by  regulation,  cannot  charge  for  their  services  as  pilots. 
Thus,  they  must  pav  flight  expenses  themselves,  although  some  of  these  costs 
may  be  tax  deductible  as  business  expenses.  As  costs  rise,  many  of  these 
pilots  are  forced  to  fly  less  frequently  In  order  to  spread  their  expenses 
over  a  longer  period.  Such  reductions  In  the  rate  at  which  they  fly  may  occur 
both  during  training  for  private  pilot  certificates,  especially  since  Instruc¬ 
tional  costs  are  added  to  other  expenses,  as  well  as  after  certification. 

Consideration  of  the  possible  consequences  of  reductions  In  the  rates  at  which 
student  and  private  pilots  fly  raises  a  number  of  critical  questions  for  which 
there  are  currently  no  firm  answers.  Many  of  these  questions  concern  the 
effect  of  such  reductions  on  flight  training.  If  training  Is  spread  out  over 
longer  periods,  for  example,  Is  the  efficiency  of  instruction  affected?  That 
Is,  will  student  pilots  actually  need  to  accumulate  a  greater  number  of  flight 
hours  before  they  are  certificated  as  a  result  of  reduced  Instructional  effi¬ 
ciency  or,  conversely,  Is  the  lengthened  Instruction  perhaps  more  or  equiva¬ 
lently  efficient  when  compared  with  training  completed  In  shorter  calendar 
time  periods?  Determination  of  the  Influences  of  different  distributions  of 
training  time  on  Instructional  efficiency  could  aid  students  and  their 
Instructors  In  dealing  with  the  economic  consequences  of  different  rates  of 
scheduling  flight  lessons.  They  thus  could  make  more  Informed  decisions 
concerning  costs  and  the  allocation  of  training  resources. 

Of  additional  concern  Is  the  Impact  of  reductions  In  the  rate  at  which  student 
pilots  fly  during  training  on  their  performance  after  they  are  certificated. 
The  gravity  of  this  Issue  Is  apparent  in  the  facVthat  certificated  pilots 
flying  for  pleasure  have  higher  accident  rates  than  pilots  In  any  other  sector 
of  general  aviation  (see  Figure  1).  Factors  affecting  training  effectiveness 
are  of  crucial  concern  In  that  they  directly  influence  how  well  student  pilots 
are  prepared  at  the  end  of  their  training  to  exercise  the  privileges  of  their 
private  pilot  certificate.  Moreover,  the  degree  of  mastery  attained  by  pilots 
during  training  Is  the  most  significant  factor  Influencing  the  retention  of 
flying  skills  after  certification  (Prophet,  1976). 
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Training  effectiveness,  especially  as  It  relates  to  degree  of  mastery  and  Its 
Influence  on  retention,  Is  a  complex  Issue.  All  private  pilots  must  meet  cer¬ 
tain  minimum  performance  standards  set  by  the  Federal  Aviation  Administration 
( FAA)  In  order  to  be  certificated  (FAA,  1975).  However,  It  Is  possible  that 
one  can  meet  minimum  performance  requirements  at  the  end  of  training,  yet  lack 
the  thorough  mastery  of  flight  skills  that  promotes  retention  of  those  skills 
and  subsequent  flight  safety.  Several  factors  Involved  in  original  training 
affect  degree  of  mastery.  One  such  factor  Is  the  relative  concentration  of 
training  over  calendar  time.  It  Is  possible,  for  example,  that  spreading 
training  over  a  moderately  long  time  period  can  sometimes  result  In  greater 
mastery,  as  shown  by  retention,  than  concentrating  the  same  amount  of  practice 
in  a  short  period.  Similarly,  spreading  practice  over  extremely  long  time 
periods  may  result  In  unacceptable  rates  of  forgetting.  Thus,  just  as  reduced 
rates  of  flying  during  training  might  affect  Instructional  efficiency  for 
better  or  for  worse,  so  may  reduced  rates  Improve  or  degrade  Instructional 
effectiveness,  as  manifested  at  the  end  of  training  and  also  In  the  years 
following  certification. 

Finally,  one  other  concern,  highly  related  to  the  one  just  described,  Is  the 
Impact  of  different  rates  at  which  private  pilots  fly  after  their  certifica¬ 
tion  on  the  retention  of  their  flying  skills.  Even  the  ski  11s  of  the  most 
proficient  pilot  will  degrade  over  time  If  not  practiced  regularly.  Evidence 
of  such  degradation  Is  apparent  In  the  common  experience  of  pilots  who  attempt 
to  fly  after  extended  periods  of  nonflying,  or  who  attempt  to  perform  flight 
tasks  that  they  have  practiced  rarely  since  initial  training— even  If  they  fly 
regularly.  Such  attempts  may  result  in  serious  errors  In  the  execution  of 
procedures,  control  of  the  aircraft,  or  even  In  making  decisions  crucial  to 
the  safety  of  flight.  These  errors,  in  turn,  may  result  in  accidents,  acci¬ 
dents  that  could  have  been  prevented  If  skill  loss  had  been  forestalled  or  at 
least  remedied  through  effective  recurrent  training.  Thus,  In  addition  to  the 
need  for  better  understanding  of  the  Impact  of  different  rates  of  flying  on 
the  efficiency  and  effectiveness  of  student  pilot  instruction,  Information  Is 
also  needed  concerning  the  Impact  of  different  rates  of  flying  after  training 
on  the  retention  of  once  proficient  flying  skills.  Such  Information  would  aid 
In  the  development  of  recurrent  training  that  would  maximize  skill  retention, 
yet  efficiently  utilize  expensive  training  resources. 

OBJECTIVES. 

In  recognition  of  the  need  for  this  Information,  the  FAA  Technical  Center  has 

Initiated  a  two-phase,  two  and  one-half  year  study  to  Investigate  the  Impact 

of  different  rates  of  flying  on  (1)  the  effectiveness  and  efficiency  of  stu¬ 
dent  pilot  training;  and  (2)  the  retention  of  private  pilot  flying  skills 

following  certification.  This  report  describes  the  results  of  the  first 

phase,  approximately  the  first  nine  months,  of  the  project. 

This  phase  of  the  study  had  two  major  objectives.  The  first  was  to  determine 
If  different  distributions  of  training  time,  l.e.,  the  rates  at  which  student 
pilots  fly  and  attend  ground  school,  have  any  Impact  on  (1)  the  final  level  of 
proficiency  attained  by  student  pilots  at  the  end  of  their  training;  and  (2) 
the  efficiency  of  Instruction.  More  specifically,  the  study  was  designed  to 
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determine  the  relative  Instructional  effectiveness  and  efficiency  of  two  pri¬ 
vate  pilot  training  programs  that  differed  only  with  respect  to  the  frequency 
or  rate  at  which  instruction  was  scheduled.  Students  In  one  program  flew  at 
one-half  the  rate  of  students  In  the  other  program.  Thus,  the  amount  of 
calendar  time  taken  for  completion  of  training  In  this  program  was,  by  design, 
about  double  that  of  the  other  program. 

The  second  major  objective  of  the  first  phase  was  to  develop  a  data  base 
describing  the  level  of  flying  skill  attained  by  Individual  pilots  at  the  end 
of  their  training.  This  data  base  will  be  used  as  a  standard  of  comparison— 
l.e.,  a  baseline— for  analyzing  the  retention  of  flying  skill  by  these  same 
pilots  In  the  two-year  period  following  their  certification.  The  analysis  of 
retention  of  flying  skills  over  extended  periods  of  time,  thus,  will  be  per¬ 
formed  In  the  second  phase  of  the  study.  This  second  phase  was  Initiated  at 
the  end  of  the  first  phase  and  Is  still  In  process  at  the  time  of  this  report. 
Second  phase  results  will  be  reported  at  a  later  date. 

Since  the  later  analyses  of  retention  will  require  an  efficiently  organized 
performance  data  base,  the  measurements  taken  during  the  first  phase  had  to  be 
designed  so  that  they  could  be  used  for  assessing  both  the  acquisition  of 
flying  skills  and  the  retention  of  these  skills.  Therefore,  the  data  obtained 
during  the  first  phase  needed  to  be  examined  to  determine  their  usefulness  for 
the  purposes  of  the  second  phase. 

In  addition  to  these  major  objectives,  the  first  phase  also  had  a  secondary 
objective:  i.e.,  to  determine  the  ability  of  pilots  to  assess  the  adequacy  of 
their  own  flying  skills.  This  objective  was  Included  to  lay  the  foundation 
for  subsequent  analyses  in  the  second  phase  which  will  be  devoted  to  gaining  a 
better  understanding  of  the  ability  of  private  pilots  to  determine  their  own 
recurrent  training  needs,  l.e.,  to  determine  when  they  need  to  practice  a 
given  flight  task  In  order  to  retain  or  regain  their  proficiency  on  that  task. 
The  ability  to  make  valid  self-assessments  Is  needed  by  private  pilots  because 
of  the  lack  of  structured  guidance  or  formal  schedules  of  recurrent  training 
for  most  of  them.  If  some  pilots  are  limited  In  their  ability  to  assess  their 
recurrent  training  needs,  Information  concerning  the  scheduling  of  this  train¬ 
ing,  such  as  will  be  produced  In  the  second  phase  In  this  effort,  will  be  of 
vital  assistance  to  these  pilots.  Moreover,  knowledge  of  the  extent  to  which 
pilots  have  such  abilities  will  aid  flight  Instructors  and  pilots  In  deter¬ 
mining  how  much  to  depend  on  a  pilot's  own  judgment  In  determining  Individ¬ 
ualized  training  needs  and  recurrent  training  requirements. 

Assessments  of  the  ability  of  pilots  to  determine  their  recurrent  training 
needs  will,  thus,  be  part  of  the  second  phase  of  this  research.  It  was  neces¬ 
sary  In  the  first  phase,  however,  to  develop  and  evaluate  the  utility  of  a 
methodology  that  could  be  employed  In  such  assessments.  Moreover,  measures  of 
the  ability  of  pilots  to  assess  their  own  performance  at  the  end  of  training 
taken  during  the  first  phase  can  be  compared  with  measures  of  this  ability 
taken  during  the  second  phase  to  determine  If  such  ability  changes  over  time. 

In  summary,  the  major  objectives  of  the  first  phase  of  the  study  were  (1)  to 
determine  If  different  distributions  of  training  time  during  private  pilot 
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Instruction  affected  the  efficiency  and  effectiveness  of  training;  and  (2)  to 
develop  and  assess  the  adequacy  of  a  performance  data  base  for  subsequent  use 
In  the  analysis  of  the  retention  of  flying  skills  during  the  second  phase.  A 
secondary  objective  was  to  develop  and  evaluate  the  use  of  a  methodology  for 
measuring  the  ability  of  pilots  to  assess  the  adequacy  of  their  own  flying 
skills. 

While  the  results  of  the  first  phase  are  of  significant  Interest  In  them¬ 
selves,  they  also  provide  the  basis  for  the  second  phase  of  the  study.  The 
objectives  of  the  second  phase  of  the  study  are  (1)  to  determine  the  effects 
of  different  distributions  of  training  time  during  private  pilot  Instruction 
on  the  retention  of  flying  skills  after  certification;  and  (2)  to  determine 
how  differences  In  the  rates  at  which  private  pilots  fly  after  certification 
affect  their  retention  of  different  flying  skills. 

Given  that  the  research  objectives  of  the  total  study  concern  both  the  acqui¬ 
sition  and  retention  of  flying  skills,  a  number  of  different  considerations 
governed  the  development  of  an  approach  for  the  accomplishment  of  these  objec¬ 
tives.  To  aid  In  explaining  the  rationale  underlying  the  approach  developed 
for  the  study,  Appendix  A  briefly  reviews  these  considerations.  The  first 
part  of  that  appendix  summarizes  relevant  aspects  of  the  extensive  research 
literature  dealing  with  the  Impact  of  different  distributions  of  practice  on 
the  acquisition  of  complex  skills.  Review  of  this  literature  provided  useful 
guidance  concerning  both  the  design  of  the  present  study  and  the  Interpre¬ 
tation  of  Its  results.  Similarly,  review  of  the  research  literature  on  reten¬ 
tion  of  complex  skills,  summarized  In  the  second  part  of  Appendix  A,  also 
provided  guidance  for  Identifying  high  priority  research  Issues  related  to 
flying  skill  retention  and  determining  how  such  Issues  should  be  addressed. 


II.  METHOD 


EXPERIMENTAL  DESIGN. 

The  present  report  describes  the  results  of  only  the  first  phase  of  the  study. 
The  design  of  the  total  study  is  presented  below,  however,  to  aid  the  reader 
In  understanding  the  context  for  the  approach  employed  In  the  first  phase. 
One  objective  of  the  overall  study  was  to  determine  the  effects  of  different 
distributions  of  training  time  on  the  effectiveness  and  efficiency  of  instruc¬ 
tion.  To  accomplish  this  objective,  two  groups  of  subjects  were  trained  using 
private  pilot  training  programs  which  differed  only  In  the  frequency  or  rate 
with  which  flight  lessons  and  ground  school  sessions  were  scheduled.  These 
frequencies  were  selected  such  that  one  program  (Program  A)  lasted  around 
three  months,  and  the  other  (Program  B),  approximately  six  months.  Figure  2 
Illustrates  the  overall  lengths  of  Programs  A  and  B.  Full  descriptions  of 
these  programs  are  given  In  Appendix  B.  Ground  school  sessions  for  students 
In  Program  A  were  scheduled  at  twice  the  relative  frequency  of  Program  B  and, 
as  a  result,  took  half  as  long  (8  weeks  versus  16  weeks)  to  complete.  Simi¬ 
larly,  students  In  Program  A  were  scheduled  to  fly  an  average  of  5.4  hours  per 
week,  while  those  In  Program  B  where  scheduled  to  fly  approximately  2.7  hours 
per  week. 

Four  flight  tests  (Numbers  1-4  In  Figure  2)  were  administered  during  each 
training  program.  Since  these  tests  corresponded  to  the  ends  of  the  four 
major  segments  of  each  flight  training  program  (see  Appendix  B) ,  the  schedule 
for  their  administration  was  relatively  more  dispensed  over  time  In  Program  B 
than  was  the  case  in  Program  A.  Similarly,  written  tests  administered  during 
and  at  the  end  of  the  ground  school  portion  of  each  program  were  scheduled  to 
match  the  different  paces  of  students  In  the  two  tracks.  The  specific  nature 
of  the  measures  taken  during  the  first  phase  to  assess  training  effectiveness 
and  efficiency  will  be  described  later.  Comparisons  of  these  measures  across 
programs  were  Intended  to  reveal  the  effects  of  the  different  distributions  of 
training  time  on  the  acquisition  of  flight  skills.  These  comparisons  are 
presented  In  the  Results  section  of  this  report. 

Another  major  objective  of  the  overall  study  was  to  determine  the  Impact  of 
different  distributions  of  flight  time,  both  before  and  after  certification, 
on  the  retention  of  flight  skills  over  extended  time  periods.  To  accomplish 
this  objective,  performance  of  the  private  pilots  trained  during  the  first 
phase  will  continue  to  be  monitored  for  a  two-year  period  following  their  cer¬ 
tification,  as  shown  In  Figure  2.  The  last  measurement  point  at  the  end  of 
training  In  the  first  phase  (No.  4)  will  provide  the  first,  or  baseline,  set 
of  data  for  use  In  calculation  of  the  retention  scores.  The  performance  of 
pilots  will  then  be  measured  three  more  times  (Numbers  5-7),  at  eight  month 
Intervals,  to  obtain  additional  data  sets.  Retention  results  will  be 
presented  In  a  later  report. 

EXPERIMENTAL  SETTING. 

The  first  phase  of  the  study  was  carried  out  at  the  FAA  Technical  Center  In 
Atlantic  City,  New  Jersey.  All  of  the  experimental  training  programs,  both 
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PROGRAMS  A  AND  B  (PHASES  ONE  AND 


ground  and  flight,  were  developed  by  Certificated  Flight  Instructors  (CFIs) 
and  their  supervisors  at  the  Bnbry-Rlddle  Aeronautical  University  (E-RAU)  In 
Daytona  Beach,  Florida.  These  programs  were  based  on  the  existing  FAA- 
approved,  E-RAU  private  pilot  training  syllabus  employed  in  the  pilot  training 
programs  taught  at  the  Daytona  Beach  campus.  The  E-RAU  syllabus  was  modified 
to  a  limited  extent  to  change  the  frequencies  with  vrttlch  flight  and  ground 
school  lessons  were  scheduled,  and  to  accommodate  certain  operational  con¬ 
straints  Imposed  on  use  of  the  programs  at  the  FAA  Technical  Center.  Summa¬ 
ries  of  the  ground  and  flight  training  syllabi  are  presented  In  Appendix  B  and 
discussed  under  Procedure. 

The  programs  were  Implemented  at  the  FAA  Technical  Center  through  the  use  of  a 
cadre  of  experienced  E-RAU  CFIs  who  were  brought  from  Daytona  Beach  and 
billeted  In  Atlantic  City  during  the  first  phase  of  the  study.  Additionally, 
most  of  the  training  aircraft  (Cessna  172s)  and  other  training  materials  were 
also  supplied  by  E-RAU' s  Daytona  Beach  campus.  Since  training  during  the 
study  was  based  on  a  well-established,  standardized  program,  and  since  It  was 
conducted  by  experienced  personnel  familiar  with  that  program,  the  experi¬ 
mental  setting  provided  an  adequate  level  of  experimental  control  over 
training  content  and  practices,  as  well  as  a  high  level  of  training  quality. 

SUBJECTS. 

Fifty- two  FAA  employees  were  selected  Initially  to  serve  as  subjects  In  the 
present  study.  They  were  selected  from  a  larger  pool  of  FAA  employees  who  had 
volunteered  to  be  subjects  In  a  flight  study,  the  exact  nature  of  which  was 
not  disclosed  Initially.  Three  criteria  guided  selection  of  subjects  from  the 
pool:  (1)  they  had  no  previous  pilot  training  or  pilot  experience  either  In 
aircraft  or  simulators;  (2)  they  did  not  have  a  substantial  amount  of  leave  or 
temporary  duty  at  other  locations  scheduled  during  the  period  In  which  they 
would  be  trained;  and  (3)  they  did  not  plan  to  retire  or  be  transferred  during 
the  course  of  the  study.  The  52  subjects  were  randomly  selected  from  the  pool 
of  Individuals  who  met  these  criteria  and  wished  to  remain  In  the  project 
after  being  told  about  It.  These  subjects  were  then  randomly  assigned  (with 
an  exception  to  be  described  later)  to  the  experimental  programs— 26  In  each 
program.  However,  ten  of  the  original  group  later  withdrew  from  training,  and 
six  others  were  dropped  by  administrative  decision,  thereby  leaving  36  of  the 
original  group.  Replacement  subjects  were  randomly  selected  from  the  original 
pool  (as  long  as  they  met  the  three  selection  criteria)  up  until  a  time  trfien 
replacement  subjects  would  not  have  been  able  to  complete  training  In  the  time 
allotted  for  the  training  program  In  vrfilch  they  were  placed  (l.e.,  three  or 
six  months).  A  total  of  six  replacement  subjects  were  used,  thus  resulting  in 
a  final  total  of  42  subjects;  24  In  Program  A  and  18  in  Program  B.  The  Infor¬ 
mation  presented  In  the  Results  section  Is  based  on  the  performance  of  these 
42  subjects. 

Forty-six  of  the  original  subjects,  as  well  as  all  six  of  the  replacements, 
worked  at  the  FAA  Technical  Center.  Six  of  the  original  students  came  from 
FAA  Headquarters  In  Washington,  DC.  They  were  added  to  Program  A  due  to  con¬ 
straints  on  scheduling  that  prevented  any  of  those  subjects  from  entering 
Program  B.  To  ensure  that  the  Inclusion  of  all  the  Washington  students  In 
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Program  A  did  not  render  the  two  programs  noncomparable,  subjects  In  the 
Washington  group  were  compared  with  the  remaining  Program  A  subjects  In  pre¬ 
liminary  analyses.  Also,  all  Program  A  vs.  B  comparisons  reported  In  the 
Results  section  were  performed  twice,  once  for  the  full  24  Program  A  subjects 
and  once  for  Program  A  without  the  six  Washington  subjects.  Without  excep¬ 
tion,  the  Washington  group  subjects  were  comparable  to  the  other  Program  A 
subjects,  and  their  inclusion  In  program  comparisons  yielded  the  same  results 
that  were  obtained  without  them.  Hence,  all  analyses  reported  later  Include 
the  Washington  students. 

MEASURES  USED  IN  THE  STUDY. 

The  objectives  of  the  first  phase  of  the  study  required  measures  that  could  be 
used  to  determine  the  (1)  effectiveness  of  training,  (2)  efficiency  of  train¬ 
ing,  and  (3)  students'  ability  to  assess  their  own  flight  skills.  These 
measures  would  also  have  to  be  used  to  assess  flying  skill  retention  during 
the  second  phase.  To  aid  In  the  interpretation  of  results  of  both  the  first 
and  second  phases,  measures  were  also  needed  that  described  students'  percep¬ 
tions  of  various  aspects  of  their  training— 1  .e.,  their  attitudes  toward 
flying  and  toward  the  training  they  received  during  the  project.  A  number  of 
measures  were  used,  some  of  which  served  more  than  one  of  the  above  purposes. 
The  measures  will  be  described  in  this  section.  The  Procedure  section  will 
describe  the  order  In  tdilch  these  measures  were  obtained  and  the  relation  of 
the  measurement  points  to  the  training  schedule.  The  Results  section  will 
describe  their  use  In  different  analyses. 

Six  measures  were  developed  specifically  for  use  In  the  present  study.  These 
were: 

(1)  Pilot  Performance  Description  Record  (PPDR). 

(2)  Final  exon  developed  by  E-RAU  personnel  for  use  at  the  end  of 
ground  school  training. 

(3)  A  series  of  six  written  quizzes  also  developed  by  E-RAU  personnel 
and  administered  periodically  during  the  ground  school. 

(4)  A  Student  Opinion  Survey  designed  to  assess  student  reaction  to  the 
training  program  and  flying  In  general . 

(5)  A  questionnaire  that  assessed  the  ability  of  students  to  predict 
how  well  they  would  perform  on  the  fourth  checkrlde. 

(6)  A  questionnaire  that  assessed  the  ability  of  students  to  evaluate 
their  performance  on  the  fourth  checkrlde  after  they  had  completed 
It. 

Additionally,  the  following  data  were  also  collected: 

(1)  Scores  on  the  FAA  private  pilot  written  test. 

(2)  Scores  on  the  FAA  private  pilot  flight  test. 


(3)  Number  of  flight  hours  and  other  Instructor-contact  hours 

accumulated  by  the  students  during  flight  training. 

PPDR.  For  the  purposes  of  this  study,  the  most  Important  data  are  those  that 
permit  a  detailed  assessment  of  student  performance  In  the  aircraft.  Measures 

providing  these  data  had  to  meet  four  criteria:  (1)  they  had  to  Include  a 

sample  of  flight  tasks  that  were  sufficiently  broad  In  skill  requirements  to 
represent  all  major  private  pilot  skills;  (2)  measures  had  to  be  obtainable  In 
sufficient  detail  to  permit  separate  assessments  of  pilot  proficiency  on  each 
of  the  flight  tasks.  Including  Identification  of  individual  performance 
errors;  (3)  the  measures  had  to  be  objective  In  the  sense  that  (a)  they  were 
based  on  what  a  pilot  did  while  performing  a  task,  and  (b)  If  two  different 
observers  rated  the  same  performance,  the  resulting  data  would  be  essentially 
the  same;  and  (4)  procedures  for  observing  performance  and  recording  data  had 
to  be  readily  adaptable  to  use  by  checkpllots  during  checkrldes. 

All  of  these  criteria  can  be  met  by  suitable  adaptations  of  the  PPDR.  This 
Instrument,  developed  originally  by  Smith,  Flexman,  and  Houston  (1952),  and 
subsequently  modified  by  Greer,  Smith,  and  Hatfield  (1962)  and  by  Prophet  and 
Jolley  (1969),  focused  on  satisfying  the  four  criteria  above.  Wide  usage  of 
the  PPDR  has  further  demonstrated  its  value  for  assessing  flight  skills,  as 
well  as  Its  adaptability  to  particular  research  needs  and  locales. 

Because  students'  repertoires  of  skills  would  Increase  as  additional  tasks  are 
Introduced  during  training,  the  number  of  tasks  Included  In  successive  check- 
rides  would  Increase  as  well.  It  was  desirable,  therefore,  to  divide  the  PPDR 
Into  three  subsets  of  tasks  (referred  to  as  I,  II,  and  III)  to  be  assessed. 
Subset  I  tasks,  those  taught  first  in  the  program,  were  comprised  of  basic 
flight  skills,  (e.g.,  normal  landings,  climbs).  Subset  II  tasks,  which  were 
Introduced  somewhat  later  In  training,  were  generally  more  complex  and 
required  a  higher  level  of  skill  development,  (e.g.,  so ft- field  takeoffs, 
accelerated  stalls).  Subset  III  tasks  were  mainly  those  associated  with 
cross-country  operations.  These  tasks  are  listed  by  subset  In  Table  1. 

The  three  task  subsets  were  employed  to  construct  flight  tests  for  use  on  the 
four  checkrldes  given  during  training.  Table  2  Identifies  which  task  subsets 
were  used  for  each  checkrlde.  On  Checkrlde  1,  performance  of  the  students  was 
measured  only  on  Task  Subset  I.  On  Checkrlde  2,  performance  was  measured  on 
both  Task  Subsets  I  and  II.  On  Checkrlde  3  and  4,  performance  was  measured  on 
all  three  task  subsets.  The  schedule  for  teaching  the  tasks  Included  In  each 
subset  and  Its  relation  to  the  schedule  for  the  four  checkrldes  Is  described 
under  Procedure. 

The  particular  tasks  to  Include  in  each  set  were  selected  to  satisfy  the  first 
criterion  given  earlier.  That  is,  they  were  chosen  so  as  to  be  representative 
of  all  major  private  pilot  skills.  Selections  were  made  by  personnel  who  had 
considerable  experience  In  the  development  of  pilot  performance  measures.  To 
guide  their  selection,  they  consulted  the  reports  dealing  with  the  development 
of  the  PPDR  (Smith  et  al.,  1952;  Greer  et  al.,  1962;  Prophet  and  Jolley,  1969) 
as  well  as  the  following  documents: 
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TABLE  1.—  CONTENTS  OF  EACH  OF  THE  TASK 
SUBSETS  IN  THE  PPDR 


TASK  SUBSET  I 


PrefMght  inspection  procedures 
Engine  start  and  pretaxi  check 
Taxiing  to  takeoff  position 
Ground  communications  (to 
takeoff) 

Engine  run-up  and  before  takeoff 
check 

Takeoff  and  departure 
Turn  to  assigned  heading 
Straight  and  level 
Minimum  controllable  airspeed 
Takeoff  and  departure  stall 
Approach  to  landing  stall 


Engine  failure  during  flight 
Before  landing  procedures 
Traffic  pattern  (uncontrolled 
field) 

Landing  (normal;  uncontrolled 
field) 

Traffic  pattern  (controlled  field) 
Landing  (controlled  field) 

Taxiing  to  ramp 

Ground  communications  procedures 
(to  ramp) 

Securing  aircraft  procedures 
All  airborne  communications 


TASK 


Steep  turns  (720°) 
Accelerated  stall 
Forced  landing  procedures 
Go- around  procedures 
Short- field  takeoff 
Short- field  landing 
Soft- field  takeoff 
Crosswind  landing 
Crosswind  takeoff 


SUBSET  II 

S-turns  across  a  road 
Turns  about  a  point 
Rate  climb  (hood)* 

Magnetic  compass  turn  (W-S;  270) 
(hood)* 

Unusual  attitude  recovery  (hood)* 
180°  turns  (hood)* 

Airspeed  change  (hood)* 

VOR  tracking  Thood)* 


TASK  SUBSET  III 


Cross-country  planning 
VOR  tracking  (cross-country; 
Inbound) 

VOR  tracking  (cross-country; 
outbound) 

First  leg  (cross-country) 
Diversion  to  alternate  field 


*These  tasks  were  performed  while  the  student  wore  a  view-limiting  device 
(hood)  that  restricted  Ms  vision  to  aircraft  Instruments. 


•  FAA  private  pilot  flight  test  guide  (FAA,  1975) 

•  E-RAU  private  pilot  flight  training  syllabus  developed  for  the 
present  study  (see  Appendix  B) 

•  Cessna  172  information  manual  (Cessna,  1979) 

•  The  Student  Pilot's  Flight  Manual  (Kershner,  1979) 

•  Flight  Training  Handbook  (FAA,  1980) 

TABLE  2.— IDENTIFICATION  OF  THE  TASK  SUBSETS 
EMPLOYED  IN  EACH  CHECKRIDE 


Check ride  ^ 

1  X 

2  X 

3  X 

4  X 


Task  Subsets 

— n —  m 

X 

X  X 

X  X 


Scoring  flight  performance  on  the  PPDR  involves  assessments  of  how  well  a 
pilot  performs  each  of  several  components  of  a  task.  The  components  vary  from 
one  task  to  another,  both  in  number  and  In  nature.  For  present  purposes,  each 
component  was  scored  as  either  "satisfactory"  or  as  an  "error."  If  a  particu¬ 
lar  indicator  such  as  airspeed,  heading,  bank  angle,  etc.,  was  within  toler¬ 
ance  as  defined  for  that  component  and  task,  a  "satisfactory"  performance  was 
recorded.  If  the  Indicator  was  out  of  tolerance,  regardless  of  direction  (too 
little  or  too  much  airspeed,  for  example),  an  error  was  recorded  for  that 
component.  A  facsimile  of  the  PPDR  Is  given  In  Appendix  C. 

The  PPDR  measures  were  transformed  Into  percentages  of  error  for  analyses. 
That  Is,  the  total  number  of  maneuver  components  that  were  out  of  tolerance 
during  a  checkrlde  was  divided  by  the  number  of  scored  components,  and  then 
multiplied  by  100.  The  maximum  number  of  scored  components  was  170  for  Subset 
I,  358  for  Subset  II,  and  390  for  Subset  III. 

E-RAU  FINAL  WRITTEN  EXAMINATION.  The  final  written  exam  was  developed  by  the 
E-RAU  ground  school  instructor.  The  major  goal  of  the  test  was  to  determine 
If  the  students  were  ready  to  take  the  FAA  Private  Pilot  Airplane  Written 
Examination.  As  such,  the  content  and  format  of  the  test  were  very  similar  to 
the  FAA  exam,  which  Is  described  later.  The  knowledge  areas  and  format 
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(multiple  choice)  that  are  described  for  the  FAA  exam  are  exactly  the  same  as 
those  for  the  E-RAU  written  exam.  Administration  of  the  E-RAU  final  exami¬ 
nation  Is  discussed  under  Procedure.  These  tests  were  scored  by  determining 
the  percentage  of  answers  that  were  correct. 

E-RAU  GROUND  SCHOOL  QUIZZES.  A  series  of  six  written  tests  were  developed  by 
tfie  ground  school  Instructor  and  given  to  the  students  to  monitor  their 
progress  during  the  course  of  the  ground  training.  These  tests,  or  quizzes, 
which  were  mainly  composed  of  multiple  choice  questions,  addressed  the 
following  knowledge  areas. 

Quiz  1.  Aerodynamics 

Quiz  2.  Airport  operations;  aircraft  weight  and  balance  calculations 

Quiz  3.  Aircraft  performance 

Quiz  4.  Aviation  weather 

Quiz  5.  Federal  Aviation  Regulations  (FARs) 

Quiz  6.  Radio  navigation 

Additional  detail  concerning  the  composition  of  these  tests  can  be  obtained  by 
reviewing  the  ground  school  syllabus  presented  in  Appendix  B.  The  syllabus 
describes  the  specific  course  content  that  was  covered  In  the  lessons  before 
each  of  the  quizzes  was  given.  Administration  of  these  tests  Is  described  In 
the  Procedure  section.  As  with  the  final  exam,  these  tests  were  scored  by 
determining  the  percentage  of  answers  that  were  correct. 

STUDENT  OPINION  SURVEY.  The  Student  Opinion  Survey  was  developed  to  determine 
how  the  students  viewed  their  training,  their  achievement,  and  themselves  In 
pilot  roles.  The  first  17  questions  sought  general  reactions  to  flying  and 
training  content,  practices,  and  conditions.  The  18th  question,  with  two 
parts  having  11  response  Items  each,  addressed  more  specifically  students' 
evaluations  of  aircraft  training  and  ground  training.  The  19th,  and  last, 
question  asked  students  to  rate  the  difficulty  they  experienced  In  learning 
each  of  29  maneuvers.  (These  29  maneuvers  were  also  Included  In  the  PPDR.) 
The  complete  Student  Opinion  Survey  appears  In  Appendix  D. 

SELF-ASSESSMENTS  BY  STUDENTS.  One  objective  of  the  study  was  to  determine  how 
well  the  students  could  assess  their  flight  skills;  specifically,  how  well 
could  they  predict  the  quality  with  which  they  would  perform,  and  how  well 
could  they  evaluate  their  performance  Immediately  after  completing  It?  To 
answer  these  questions,  two  questionnaires  were  developed,  one  to  be  completed 
just  before  the  fourth  and  final  checkrlde  In  the  program,  and  one  to  be 
completed  Immediately  after  that  checkrlde,  and  before  debriefing  by  the 
checkpllot. 

Both  questionnaires  appear  In  Appendix  E.  They  are  Identical  except  for  the 
Instructions.  One  asks  students  to  predict  how  many  errors  they  will  make  on 
the  checkrlde  (none  to  many  on  a  seven-point  scale),  and  the  other  asks  them 
to  estimate  the  number  actually  made.  Answers  were  to  be  provided  for  each  of 
29  maneuvers  (the  same  29  maneuvers  that  appear  In  Item  19  of  the  Student 
Opinion  Survey). 

FAA  PRIVATE  PILOT-AIRPLANE  WRITTEN  EXAMINATION.  The  FAA  Private  PI 1 ot- 
Alrplane  Written  Test  Is  described  In  detail  In  Advisory  Circular  EA-AC  61-32B 
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(FAA,  1977).  The  test  was  developed  by  FAA  and  Is  administered  to  all  student 
pilots  who  desire  to  qualify  for  their  private  pilot  certificate.  During  the 
present  effort,  this  test  was  administered  by  Independent  FAA  personnel  *too 
had  no  other  role  in  the  study. 

The  test  covers  the  following  knowledge  areas: 

•  FARs  (Parts  1,  61,  71,  91) 

•  National  Transportation  Safety  Board,  Procedural  Regulation, 
49  CFR  830 

•  FAA  Advisory  Circulars 

•  Airman's  Information  Manual 
o  Aviation  weather 

•  Airplane  operation 

•  Engine  operation 

•  Navigation 

•  Aerodynamics  and  principles  of  flight 
a  Flight  Instruments  and  systems 

a  Radio  communications 

The  FAA  exam  contains  60  selected  multiple-choice  Items,  selected  from  a 
larger  pool  of  600  Items  (presented  in  EA-AC  61-32B).  Format  of  the  multiple 
choice  Items  and  general  procedures  for  administration  of  the  exam  are 
described  In  Advisory  Circular  EA-AC  61-32B  (FAA,  1977).  These  tests  were 
scored  by  determining  the  percentages  of  answers  that  were  correct. 

FAA  PRIVATE  PILOT-AIRPLANE  FLIGHT  TEST.  The  FAA  flight  test  Is  described  In 
detan  In  Advisory  Circular  A t  61-S4A  (FAA,  1975).  This  advisory  circular 
contains  guidance  developed  by  the  FAA  for  conduct  of  the  Private  Pilot- 
Airplane  Flight  Test  by  FAA  Inspectors  and  designated  pilot  examiners  (l.e., 
pilots  who  are  not  FAA  employees,  but  who  are  authorized  by  the  FAA  to  admin¬ 
ister  flight  tests).  All  student  pilots  desiring  to  receive  their  private 
pilot  certificate  must  take  and  pass  this  test.  During  the  present  effort, 
these  flight  tests  were  administered  by  Independent  FAA  Inspectors  and 
designated  pilot  examiners. 

The  Private  Pilot-Airplane  Flight  Test  may  Include  assessment  of  any  of  the 
following  maneuvers  and  procedures. 

a  Prefl  Ight  operations 

•  Airport  and  traffic  pattern  operations 


•  Flight  maneuvering  by  reference  to  ground  objects 

•  Flight  at  critically  slow  airspeeds 

•  Takeoffs  and  landings 

•  Maneuvering  by  reference  to  Instruments 
t  Cross-country  flying 

•  Maximum  performance  take-offs  and  landings 

•  Night  flying  -  night  VFR  navigation  (optional) 

•  Emergency  operations 

Format  of  the  Private  Pilot-Airplane  Flight  Test  and  general  procedures  for 
Its  administration  are  described  in  AC  61-54A.  For  purposes  of  the  present 
study,  these  tests  were  scored  on  a  pass-fail  basis. 

FLIGHT  HOURS  AND  OTHER  INSTRUCTOR-CONTACT  HOURS.  The  number  of  flight  hours 
students  spent  fh  various  activities  related  to  training  reflect  the  effi¬ 
ciency  of  their  Instruction.  While  a  minimum  number  of  flight  hours  is 
required  by  FAA  regulations  (l.e.,  20  solo  and  20  dual  hours),  differences 
among  students  In  flight  hours  reflect,  to  a  certain  extent,  differences  In 
the  amount  of  effort  they  (and  their  instructors)  devoted  to  training. 
Accordingly,  flight  hour  measures  were  obtained  as  follows: 

Hours  spent  in: 

•  Solo  flight 

•  Dual  flight 

•  Cross-country  (dual  and  solo)  flight 
Total  hours: 

t  Preceding  the  first  solo  flight 
t  Preceding  Checkrlde  1 
t  Preceding  Checkrlde  2 

•  Preceding  Checkrlde  3 

•  Preceding  Checkrlde  4 

In  addition  to  flight  hours,  the  number  of  hours  the  student  spent  with  his 
flight  Instructor  (In  addition  to  regular  ground  school)  was  also  recorded. 
Some  of  these  hours,  referred  to  as  "oral"  hours,  were  regularly  scheduled  In 
the  flight  training  syllabus.  Other  oral  hours  were  at  the  request  of  the 
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students  or  their  Instructors.  As  such,  the  total  number  of  oral  hours 
reflects,  to  a  degree,  another  aspect  of  the  amount  of  effort  put  Into  train- 
ing  by  a  student. 

PROCEDURE. 

Appendix  B  contains  the  syllabi  for  the  ground  and  flight  training  courses. 
As  previously  stated  under  Experimental  Design,  Programs  A  and  B  differed  only 
in  that  the  rate  of  training  In  Program  B  In  both  ground  and  flight  courses, 
was  approximately  one-half  that  of  Program  A.  Thus,  ground  training  took  two 
months  in  Program  A  and  4  months  in  Program  B.  Similarly,  flight  training 
took  three  months,  in  Program  A  and  six  months  In  Program  B. 

The  ground  school  was  composed  of  15  lessons,  the  contents  of  which  are 
described  in  Appendix  B.  Students  in  Program  A  met  as  a  class  twice  weekly 
(i.e.,  covered  two  lessons  per  week),  while  those  in  Program  B  met  as  a  class 
only  once  a  week.  The  same  ground  school  Instructor  taught  students  In  both 
programs.  As  shown  in  the  syllabus  in  Appendix  B,  students  received  their  six 
quizzes  (discussed  under  Measures  Used  In  the  Study)  during  lessons  2,  4,  5, 
7,  10,  and  14.  They  received  the  E-RAU  final  written  examination  during  the 
15th  lesson.  Following  successful  completion  of  the  ground  school,  the  stu¬ 
dents  were  given  the  FAA  Private  Pilot-Airplane  Written  Test.  This  exami¬ 
nation  was  administered  by  FAA  personnel  not  Involved  In  the  present  study. 

Programs  A  and  B  were  initiated  simultaneously.  Additionally,  flight  training 
was  initiated  concurrently  with  ground  school  training  in  both  programs. 
Figure  3  Illustrates  the  relation  between  ground  and  flight  training  in  Pro¬ 
grams  A  and  B.  The  schedule  of  flight  training  activities  is  described  In 
detail  In  Appendix  B.  Briefly,  flight  training  was  divided  into  four  major 
phases.  Phase  I,  referred  to  as  the  Presolo  Phase,  contained  9  lessons 
designed  to  prepare  the  student  to  solo  the  aircraft.  Phase  II,  Basic  Pilot 
Operations,  contained  5  lessons  designed  to  increase  the  student's  knowledge 
of  basic  and  advanced  flight  operations.  Phase  III,  Cross-Country  Flight 
Operations,  was  devoted  to  training  the  student  to  conduct  cross-country 
flights.  It  consisted  of  5  lessons.  Finally,  Phase  IV,  Pilot  Operations- 
Private  Pilot,  was  designed  to  allow  the  student  to  review  previously  learned 
skills  and  prepare  for  the  FAA  private  pilot  flight  test.  It  consisted  of  3 
lessons.  Thus,  flight  training  was  composed  of  4  major  phases  and  22  lessons. 

Each  of  the  lessons  provided  guidance  concerning  the  number  of  flight  hours 
required,  dual  and  solo,  as  well  as  oral  hours.  Students  advanced  through  the 
lessons,  however,  on  the  basis  of  their  Individual  proficiency  as  demonstrated 
to  the  Instructor  In  flight  and  In  oral  reviews.  Thus,  the  number  of  flight 
hours  spent  on  any  one  lesson  or  In  any  one  phase  was  determined,  to  a  degree, 
by  the  rapidity  with  which  students  mastered  the  objectives  of  the  lesson  or 
phase. 

The  programs  were  designed  so  that  students  would  fly,  when  possible,  with  the 
same  instructor  during  the  entire  flight  training  program.  Certain  opera¬ 
tional  constraints,  however,  prevented  this  goal  from  being  completely 
attained.  As  a  result,  most  students  had  a  major  instructor  with  vrftom  they 
flew  a  majority  of  the  time  and  one  or  two  other  Instructors  from  whom  they 
received  training  the  remainder  of  the  time. 
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FIGURE  3.— COMPARISON  OF  FLIGHT  AND  GROUND  TRAINING 
SCHEDULES  IN  PROGRAMS  A  AND  B. 


The  four  flight  checkrides  were  given  at  the  end  of  each  of  the  major  phases. 
Each  of  the  checkrides  was  structured  so  that  tasks  were  administered  -in  the 
same  sequence  In  all  checkrides.  That  Is,  as  Task  Subset  II  was  added  on 
checkrides,  the  order  In  which  tasks  In  Subset  I  were  assessed  remained  the 
same  as  in  Checkrlde  1.  Similarly,  when  Task  Subset  III  was  added,  the  order 
in  which  tasks  in  Subsets  I  and  II  were  assessed  remained  the  same. 

The  checkrides  were  administered  by  four  checkpllots.  Checkrides  were  sche¬ 
duled  so  that  the  checkpllot  for  a  given  student  was  not  directly  involved  In 
the  training  (l.e.,  was  not  a  major  instructor)  of  the  student  being  assessed. 
The  checkpllots,  who  aided  In  development  of  the  PPDR,  received  extensive 
ground  and  flight  training  concerning  the  use  of  the  PPDR  for  checkrides.  A 
handbook  for  the  PPDR,  presented  in  Appendix  E,  was  developed  to  serve  as  both 
an  aid  during  checkpllot  training  and  as  an  aid  for  maintaining  standardi¬ 
zation  of  the  flight  tests  during  data  collection. 


III.  RESULTS  AND  DISCUSSION 


The  results  of  the  experiment  are  discussed  under  four  major  headings.  First, 
the  effectiveness  of  training  administered  In  Programs  A  and  B  Is  examined. 
Second,  the  efficiency  of  that  training  is  viewed  from  the  standpoint  of 
amounts  of  training  effort  and  practice,  and  of  certain  training  process  con¬ 
siderations.  Third,  the  extent  to  which  students  were  able  to  predict  and 
evaluate  their  own  performance  on  the  end-of-course  checkrlde  Is  described. 
Finally,  student  reactions  to  training,  as  measured  by  the  Student  Opinion 
Survey,  are  analyzed. 

1.  TRAINING  EFFECTIVENESS. 

With  respect  to  the  first  phase  of  the  study,  training  effectiveness  was 
defined  in  terms  of  the  performance  of  the  students,  both  academic  and  flight, 
at  the  end  of  their  training.*  Training  effectiveness  in  the  academic  area 
was  defined  In  terms  of  two  measures  of  performance:  (1)  the  E-RAU  final 
written  exam  administered  at  the  end  of  the  ground  school;  and  (2)  the  FAA 
Private  Pilot-Airplane  Written  Test.  Similarly,  flight  training  effectiveness 
was  based  on  two  measures:  (1)  the  PPDR  administered  during  the  fourth  and 
final  checkrlde;  and  (2)  the  FAA  Private  Pilot-Airplane  Flight  Test. 

ACADEMIC  PERFORMANCE.  Table  3  shows  the  means  (M)  and  the  standard  deviations 
(SD)  for  students'  In  Programs  A  and  B  on  the  E-RAU  final  written  examination, 
and  the  FAA  Private  Pilot-Airplane  Written  Test.  T-tests  were  employed  to 
evaluate  the  differences  between  the  mean  scores  for  Programs  A  and  B.  These 
differences  were  not  statistically  significant  for  either  examination,  the  ts 
being  0.99  for  the  E-RAU  final  examination  and  0.47  for  the  FAA  written 
test.1 2  As  for  the  standard  deviations,  the  differences  between  tracks  were 
also  well  within  the  range  of  chance  sampling  variation. 

FLIGHT  PERFORMANCE.  As  explained  In  the  Method  section,  PPDR  measures  were 
divided  into  three  task  subsets— I,  II,  and  III.  During  the  fourth  checkrlde, 
performance  was  measured  on  all  three  subsets.  The  analysis  that  follows 
addresses  (1)  differences  between  the  two  experimental  programs  (A  and  B)  in 
terms  of  overall  performance  across  all  task  subsets,  (2)  differences  between 


1 

As  discussed  In  the  Introduction,  the  effectiveness  of  flight  training 
can  also  be  viewed  In  terms  of  the  retention  of  skills  In  the  years  following 
certification.  As  such,  measures  of  flight  skill  retention  obtained  during 
Phase  II,  will  also  reflect,  In  part,  the  effectiveness  of  the  training  the 
pilots  received  In  Phase  I. 

2 

For  readers  who  are  unfamiliar  with  statistics  commonly  employed  in  the 
behavioral  sciences,  Appendix  G  provides  a  short  description  of  the  statisti¬ 
cal  analyses  employed  In  this  report.  Deviations  from  commonly  employed  anal¬ 
yses  are  noted  In  the  text,  and  references  are  provided  for  those  n4io  wish 
further  Information  concerning  these  less  common  analyses. 


programs  In  terms  of  performance  on  each  of  the  separate  subsets,  and  (3)  dif¬ 
ferences  among  the  subsets  themselves.  The  analysis  Involved  an  adaptation  of 
the  analysis  of  variance  (ANOVA)  technique.  Using  this  statistical  analysis, 
It  was  possible  to  compare  the  performance  of  students  In  Programs  A  and  B  In 
terms  of  performance  across  all  subsets  as  well  as  to  analyze  Interactions 
between  programs  and  task  subsets,  l.e.,  determine  If  the  relative  performance 
of  students  In  the  two  programs  differed  as  a  function  of  the  separate  task 
subsets.  The  adaptation  of  the  ANOVA  referred  to  was  made  necessary  by  the 
unequal  numbers  of  students  In  the  two  programs.  Specifically,  the  adaptation 
was  the  use  of  an  unweighted  means  solution  described  by  Winer  (1971,  p.  599f). 


TABLE  3.— MEANS  (M)  AND  STANDARD  DEVIATIONS  (SD) 
ON  THE  E-RAU  FTNAL  EXAMINATION  AND  THE  FAA 


PRIVATE 

PILOT-AIRPLANE 

WRITTEN 

TEST 

E-RAU 

FAA 

Program 

N 

M 

SD 

N 

M 

SD 

A 

24 

91.79 

7.02 

23 

92.09 

6.77 

B 

18 

89.61 

7.15 

17 

91.06 

6.91 

A  summary  of  the  ANOVA  for  percent  error1  on  the  PPDR  Is  shown  In  Table  4. 
Overall  performance  (across  all  task  subsets)  of  the  students  In  the  two 
programs  did  not  differ  significantly.  That  Is,  no  significant  differences 
between  programs  were  observed  when  performance  was  averaged  across  all  task 
subsets.  As  can  be  seen  from  the  F  ratios  of  20.40  and  4.20  In  Table  4, 
however,  significant  differences  did  occur  with  respect  to  task  subsets  and 
the  program  by  task  subset  Interaction.  The  pattern  of  these  differences  and 
the  Interaction  Is  shown  In  Figure  4. 


Analysis  of  percent  error  measures  In  Task  Subset  II  excluded  measures 
obtained  for  five  maneuvers:  S  turns;  turns  about  a  point;  rate  climb  (under 
the  hood);  magnetic  compass  turn  (under  the  hood);  and  airspeed  change  (under 
the  hood).  These  measures  were  not  obtained  for  8  of  the  18  students  In 
Program  B  due  to  operational  constraints  that  prevented  their  measurement. 
Similarly,  In  Task  Subset  I,  the  analysis  of  percent  errors  excludes  "landing 
at  a  controlled  airport,"  since  completion  of  all  components  of  this  task  on 
the  checkrlde  was  frequently  thwarted  due  to  air  traffic  considerations  for 
many  of  the  subjects  in  both  programs. 
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FIGURE  4.— MEAN  PERCENT  ERROR  FOR  TASK 
SUBSETS  I,  II,  AND  III  PPDR 
MEASURES  ON  THE  FOURTH  CHECKRIDE. 
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TABLE  4.— SUMMARY  OF  ANOVA  FOR  TASK  SUBSETS  I,  II,  AND  III 
ON  THE  FOURTH  CHECKRIDE 


Source 

df 

Mean 

square 

F 

£ 

Programs  (P) 

1 

7.61 

<1 

N$a 

Between  error 

40 

137.7 

Task  subsets  (T) 

2 

747.5 

20.40 

<.001 

P  X  T 

2 

154.0 

4.20 

<.05 

Within  error 

80 

36.64 

aNot  significant. 


While  students  In  both  programs  tended  to  perform  about  the  same  on  Subset  I, 
It  can  be  seen  In  Figure  4  that  students  In  Program  B  (the  six-month  program) 
tended  to  perform  better  than  those  In  Program  A  (the  three-month  program)  on 
Task  Subset  II.  However,  students  In  Program  B  performed  worse  on  the  average 
than  those  In  Program  A  on  Subset  III.  This  reversal  of  pattern  on  Subsets  II 
and  III  accounts  for  the  significant  Interaction  effect. 

Several  plausible  hypotheses  can  be  generated  to  explain  the  shift  In  superi¬ 
ority  of  performance  for  Program  B  on  Subset  II  to  Program  A  on  Subset  III. 
It  may  be,  for  example,  that  lower  rates  of  training  are  more  conducive  to 
learning  the  types  of  tasks,  l.e.,  mainly  psychomotor  control  tasks,  repre¬ 
sented  In  Subset  II  (also  Subset  I),  and  less  conducive  to  learning  the  more 
cognitive,  procedural  tasks  In  Subset  III.  An  alternative,  but  related, 
explanation  might  be  that  students  in  Program  B  learned  the  Subset  III  tasks 
as  well  as  those  In  Program  A,  but  that  they  did  not  retain  their  skill  as 
well  given  the  greater  delay  between  when  the  tasks  were  learned  and  the  last 
checkrlde.  Past  research  (discussed  in  Appendix  A)  has  shown,  for  example, 
that  cognitive,  procedural  tasks,  such  as  In  Subset  III,  are  less  well 
retained  over  time  than  psychomotor  tasks,  such  as  In  Subsets  I  and  II.  It 
may  be,  then,  that  students  In  Program  B  were  able  to  retain  their  skills  to 
perform  tasks  In  Subsets  I  and  II  better  than  they  could  retain  skills  to  per¬ 
form  tasks  In  Subset  III. 

With  respect  to  the  differences  In  performance  on  task  subsets,  as  reflected 
by  mean  percent  error,  It  can  be  seen  that  students  In  both  programs  tended  to 
make  more  errors  on  Task  Subset  III  than  on  Task  SubsetTIT  and  that  they  also 
tended  to  make  more  errors  on  Task  Subset  II  than  on  I.  These  differences 
between  task  subset  difficulty  levels  probably  reflect  differences  In  the 
nature  of  the  tasks  In  each  of  the  subsets  and  the  amount  of  practice  afforded 
each.  As  described  In  the  Methods  section,  tasks  In  Subset  I  were  relatively 
simple  maneuvers  and  procedures  concerned  with  routine  control  of  the  air¬ 
craft.  They  were  learned  first  and  performed  routinely  throughout  training 
(e.g.,  normal,  as  opposed  to  maximum  performance,  landings  and  takeoffs  were 
made  on  most  flights).  Tasks  In  Subset  II  were  usually  more  difficult  and 
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complex  maneuvers  requiring  more  precise  control  of  the  aircraft  and  the 
tlmeshared  performance  of  multiple  tasks  elements.  Similarly,  tasks  In  Subset 
II  were  learned  earlier  In  the  program  than  those  In  Subset  III.  Tasks  In 
Subset  III,  which  came  last  In  the  program,  were  concerned  mainly  with  cross¬ 
country  flight  and  were  more  of  a  cognitive,  and  usually  more  difficult, 
nature  than  those  In  the  other  subsets.  That  Is,  students  were  required  to 
Interpret  a  wide  variety  of  Information,  perform  various  calculations,  make 
decisions,  plan,  and  revise  their  plans.  Thus,  the  differences  In  performance 
on  the  task  subsets  probably  reflect  the  order  In  which  the  tasks  were 
learned  and  the  amount  of  practice  each  received,  as  well  as  dissimilarities 
In  the  nature  of  the  tasks  In  each  subset. 

In  summary  to  this  point,  It  appears  that  there  were  no  overall  differences  In 
the  performance  of  students  In  Programs  A  and  B  on  the  fourth  checkrlde  with 
respect  to  the  three  task  subsets.  Students  In  both  programs  tended  to  do 
better  on  tasks  In  Subset  I  than  those  In  Subset  II,  and  better  on  tasks  In 
Subset  II  than  those  In  Subset  III.  Students  In  Program  B  tended  to  do  better 
than  those  In  Program  A  on  Subsets  I  and  II,  but  worse  on  tasks  In  Subset  III. 
However,  neither  program  exhibited  a  real  overall  advantage  In  training 
effectiveness  as  reflected  In  the  PPDR  end-of-course  checkrlde  data. 

FAA  PRIVATE  PILOT-AIRPLANE  FLIGHT  TEST.  Six  students  In  Program  A  failed  the 
FAA  flight  test  the  first  time  they  took  it,  while  only  two  students  In  Pro¬ 
gram  B  failed  It  the  first  time.  All  of  the  students  who  failed  except  one 
fin  Program  A)  passed  the  flight  test  the  next  time  they  took  It.  The  differ¬ 
ence  between  failure  rates  Is  well  within  the  range  of  sampling  error,  how¬ 
ever.  The  chi  squared  for  the  difference,  corrected  for  continuity,  was  only 
0.54,  well  below  the  value  required  for  significance  at  the  .05  level.  Thus, 
as  with  the  PPDR  data  on  the  fourth  checkrlde,  there  appears  to  be  no  overall 
training  effectiveness  difference  between  programs  with  reference  to 
performance  on  the  FAA  Private  Pilot-Airplane  Flight  Test. 

2.  TRAINING  EFFICIENCY. 

The  second  major  aspect  of  the  results  Is  that  concerned  with  the  efficiency 
of  the  two  programs.  Training  efficiency  was  assessed  with  respect  to  (1)  the 
number  of  flight  and  oral  hours  spent  by  students  In  various  training  activi¬ 
ties,  (2)  the  patterns  of  progress  of  the  students  through  flight  training  as 
measured  on  the  four  flight  checkrloes,  and  (3)  the  patterns  of  progress  of 
the  students  through  ground  school  as  measured  on  the  six  written  quizzes. 

FLIGHT  AND  ORAL  HOURS.  The  most  Important  questions  concerning  training  effl- 
clency,  from  the  standpoint  of  practical  training  procedures,  relate  to  dif¬ 
ferences  In  the  amount  of  training  effort  required  for  students  In  each 
program  to  reach  proficiency  In  the  skills  being  trained.  That  Is,  do  stu¬ 
dents  tend  to  require  more  or  less  flight  time  and  a  greater  or  lesser  amount 
of  contact  with  their  Instructors  as  a  function  of  how  their  training  Is 
distributed  over  calendar  time  periods?  Such  differences,  if  they  exist, 
ultimately  translate  Into  cost  and  fuel  use  differences.  The  standard  train¬ 
ing  regimens  for  the  two  groups  In  the  present  study  were  comparable  from  the 
standpoint  of  quality  of  formal  Instruction  and  the  proficiency  objectives  to 
be  obtained.  The  only  real  difference  was  that  Program  A  received  all  their 
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training  during  a  three-month  period  mtolle  Program  B's  training  extended  over 
six  months.  Thus,  differences  In  amount  of  effort  to  reach  proficiency  would 
be  reflected  primarily  In  the  amount  of  time  students  spent  In  preparation  for 
solo  and  checkrldes,  l.e.,  In  dual  and  solo  flight  hours  and  In  oral  hours. 

Table  5  shows  means  (M)  and  standard  deviations  (SD)  of  flight  hours  and  oral 
Instruction  hours  at  “various  points  In  the  two  programs.  Also  shown  are  Ms 
and  SDs  for  various  categories  of  flight  hours  such  as  total  dual,  total  solo, 
cross-country  <X-C)  solo,  etc.  As  Is  apparent  from  the  t  ratios  In  the  table, 
students  In  Program  B  received  significantly  fewer  hours  In  the  air  prior  to 
Checkrldes  1  and  3.  They  also  had  significantly  less  dual  Instruction  time 
and  total  solo  plus  dual  time  (the  solo  +  dual  difference  shown  in  the  table 
Is  due  to  the  difference  In  dual  alone).  Two  other  differences— fl ight  hours 
preceding  the  fourth  checkrlde  and  hours  of  oral  Instruction — approached 
significance,  and  In  both  cases  students  In  Program  B  had  fewer  mean  hours. 


TABLE  5.— HOURS  IN  TRAINING/FLIGHT  BY  SELECTED  CATEGORIES 


Program  A  (N-24) 

Program  B  (N-1B) 

Category 

m  scr 

M  SET 

t 

Flight  hours  preceding: 


Checkrlde  1 

17.35 

2.63 

15.60 

3.10 

1.98* 

Solo 

18.81 

2.64 

17.73 

3.67 

1.11 

Checkrlde  2 

38.97 

3.82 

38.69 

6.15* 

0.18 

Checkrlde  3 

51.81 

4.34 

48.54 

6.17 

2.02* 

Checkrlde  4 

67.55 

5.25 

63.57 

8.70* 

1.84 

Flight  hours  spent: 

Solo 

26.04 

2.71 

26.29 

5.55** 

0.19 

Dual 

45.93 

5.28 

39.63 

5.64 

3.72*** 

Solo  +  Dual 

71.97 

5.70 

65.92 

8.55 

2.75** 

X-C  Solo 

11.20 

1.05 

12.32 

3.04** 

1.68 

X-C  Dual 

7.76 

2.11 

8.03 

2.78 

0.36 

Total  X-C 

18.% 

2.09 

20.36 

3.82** 

1.52 

Hours  oral  Instruction 

22.45 

4.27 

20.04 

4.53 

1.76 

♦Difference  between  SDs  or  Ms  significant  at  or  beyond  .05  level. 

♦♦Difference  between  ?Bs  or  Ms  significant  at  or  beyond  .01  level. 

♦♦♦Difference  between  5Es  or  TTs  significant  at  or  beyond  .001  level. 


The  SDs  of  hour  measures  shown  In  Table  5  also  had  a  systematic  pattern  of 
differences.  They  were  larger  for  Program  B  than  for  Program  A  In  every 
instance,  and  significantly  so  In  five.  This  result  Implies  an  Interaction  of 
the  training  process  with  characteristics  of  Individual  students.  That  is, 
the  longer  training  period  for  Program  B  resulted  In  the  Program  B  students 
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being  significantly  more  variable  In  their  training  times  than  were  those  In 
Program  A.  It  should  be  noted,  however,  that  all  Instances  of  Program  B's 
significantly  greater  variability  Involved  solo  flight,  and  not  just  direct 
contact  with  flight  Instructors.  Variabilities  of  hours  concerned  with  direct 
contact  with  flight  Instructors  were  generally  comparable  for  the  two 
programs,  as  Indicated  by  SD s  for  Dual  and  X-C  Dual. 

The  conclusion  with  reference  to  training  flight  time  Is  that  the  training 
process  was  slightly  more  efficient  when  the  training  was  spread  over  six 
months  rather  than  three.  However,  one  may  also  examine  efficiency  In  terms 
of  performance  as  measured  during  flight  training  and  the  manner  and  rate  at 
which  Individual  skills  develop.  The  next  section  examines  training  effi¬ 
ciency  In  terms  of  performance  over  the  four  flight  tests  administered  during 
training. 

FLIGHT  CHECKRIDES.  As  previously  discussed,  PPDR  measures  were  divided  Into 
three  subsets— 1,  II,  and  III— corresponding  to  groups  of  tasks  Introduced  at 
successive  times  during  training.  ^  shown  In  Table  2  In  the  Methods  section. 
Subset  I  measures  were  obtained  on  each  of  the  four  checkrides;  Subset  II 
measures  were  obtained  on  Checkrides  2,  3,  and  4;  and  Subset  III  measures  were 
obtained  on  Checkrides  3  and  4.  The  following  analyses  focus  on  the  separate 
subsets  and  the  students'  change  In  performance  over  the  corresponding  check¬ 
rides.  ANOVAs  for  repeated  observations,  adapted  as  previously  described  to 
accommodate  unequal  numbers  of  students,  were  used  to  analyze  differences  In 
the  performance  of  students  across  checkrides  and  programs. 

Task  Subset  I.  A  summary  of  the  ANOVA  for  percent  errors  on  Subset  I  of 
the  PPbR  measures  appears  In  Table  6.  Data  for  24  Program  A  and  18  Program  B 
students  are  Included  In  the  analysis.  One  maneuver,  Traffic  Pattern,  Con¬ 
trolled,  was  eliminated  from  this  set  because  most  of  the  students  In  the  two 
programs  did  not  have  sufficient  opportunities  to  perform  It  due  to  opera¬ 
tional  constraints.  The  programs  did  not  differ  significantly  on  total  errors 
across  all  four  checkrides.  However,  the  Program-by-Checkrlde  Interaction 
reached  borderline  significance  with  a  £  of  approximately  .05. 


TABLE  6.— SUMMARY  OF  ANOVA  FOR  TASK  SUBSET  I 


Source 

df 

Rean 

square 

F 

£ 

Program  (P) 

1 

68.71 

1.00 

NS 

Between  error 

40 

68.80 

Checkrlde  (C) 

3 

1409. 

34.43 

<.001 

P  x  C 

3 

136.8 

3.34 

.05 

Within  error 

120 

40.92 

Note:  Data  for  Traffic  Pattern,  Controlled,  not  included. 


The  source  of  the  borderline  Interactive  effect  is  apparent  In  Figure  5 
where  means  for  each  program  are  plotted  by  checkrlde.  Program  B  changed  from 
slightly  poorer  performance  than  Program  A  on  the  first  checkrlde  to  a  some¬ 
what  better  performance  than  Program  A  on  the  other  three.  The  greatest 
discrepancy  between  programs,  however.  Is  on  the  third  checkrlde.  Thus,  It  Is 
the  third  checkrlde,  given  after  the  cross-country  operations  phase,  that 
departs  most  from  an  otherwise  similar  pattern  of  means  for  the  two  programs, 
and  hence  contributes  most  to  the  Interaction. 

The  source  of  the  difference  on  the  third  checkrlde  was  determined  by 
comparing  the  two  programs  maneuver  by  maneuver.  On  7  of  the  19  maneuvers  In 
Subset  I  (Traffic  Pattern,  Controlled  was  excluded)  no  student  In  either 
program  made  an  error.  On  11  of  the  remaining  12  maneuvers,  however.  Program 
B  had  a  lower  mean  percent  error  than  did  Program  A.  Furthermore,  ts  on  4  of 
the  11  maneuvers  reached  the  .05  level  of  significance:  Traffic"  Pattern , 
Uncontrolled;  Normal  Landing,  Uncontrolled;  Landing,  Controlled;  and  Taxi  to 
Ramp.  The  overall  superiority  of  Program  B  on  the  third  checkrlde,  together 
with  four  statistically  significant  differences,  leads  to  the  conclusion  that 
the  borderline  Interaction  Is  a  true  effect.  That  Is,  Program  B  was  actually 
superior  on  the  third  checkrlde,  even  though  performance  differences  on  the 
other  three  checkrldes  tended  to  balance  the  two  tracks  when  all  four  checkrl- 
des  are  viewed  as  a  whole. 


Figure  5  also  shows  the  basis  for  the  highly  significant  F  (jj  <  .001)  for 
checkrlde  differences.  Percent  errors  reduced  drastically  Tor  both  tracks 
from  the  first  to  the  fourth  checkrlde.  Such  a  finding  Is,  of  course, 
expected,  since  all  subjects  should  improve  In  performance,  l.e.,  exhibit 
significant  learning,  because  of  accumulated  additional  flight  experience  from 
one  checkrlde  to  the  next.  This  finding  demonstrates,  In  part,  the  validity 
of  the  PPDR  in  that  It  reveals  the  ability  of  the  measure  to  detect  different 
skill  levels  that  would  be  expected  as  learning  progresses. 

Task  Subset  II.  Because  data  on  five  tasks  were  not  available  for  8  of 
the  18  students  In  Program  B  due  to  operational  constraints  that  prevented 
their  measurement,  two  analyses  were  completed  for  error  measures  on  Subset  II 
tasks.  For  the  first  analysis,  which  Included  24  students  In  Program  A  and  18 
In  Program  B,  data  for  the  following  five  tasks  were  excluded:  $  turns;  turns 
about  a  point;  rate  climb  (performed  under  the  hood);  magnetic  compass  turn 
(performed  under  the  hood);  and  airspeed  change  (performed  under  the  hood). 
In  the  second  analysis,  only  these  five  tasks  were  considered,  using  the  data 
that  were  available. 


Table  7  presents  a  summary  of  the  ANOVA  for  the  Subset  II  error  percen¬ 
tages  (excluding  the  five  tasks  just  identified).  The  programs  differed 
beyond  the  .01  level  of  significance,  with  Program  B  having  the  lower  overall 
error.  The  Program-by-Checkrlde  Interaction  did  not  approach  significance, 
however,  so  the  Implication  Is  that  Program  B's  superiority  was  general  across 
all  three  checkrldes.  The  pattern  of  differences  can  be  seen  in  Figure  6 
where  separate  program  means  are  plotted  by  checkrlde.  Again,  differences 
from  the  first  (Checkrlde  2)  to  the  last  checkrlde  were  highly  significant  (p 
<  .001).  ^ 
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FIGURE  5. -MEAN  PERCENT  ERROR  FOR  SUBSET  I  PPDR  MEASURES 
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FIGURE  6. -MEAN  PERCENT  ERROR  FOR  SUBSET  II  PPDR  MEASURES 

(EXCLUDING  THE  FIVE  MANEUVERS  LISTED  IN  THE  TEXT) 


TABLE  7.— SUMMARY  OF  ANOVA  FOR  TASK  SUBSET  II 


Source 

df 

Mean 

square 

F 

£ 

Program  (P) 

1 

825.7 

10.57 

<.01 

Between  error 

40 

78.15 

Checkrlde  (0 

2 

977.2 

14.40 

<.001 

P  x  C 

2 

80.33 

1.18 

NS 

Within  error 

80 

67.86 

Note:  Data  for  five  tasks  described  In  text  are  not  Included. 


Performance  on  the  five  tasks  that  were  excluded  In  the  above  analysis 
was  analyzed  In  a  similar  ANOVA,  using  23  Program  A  and  10  Program  B  students 
for  whom  data  were  available.  The  results  are  summarized  In  Table  8.  In  this 
case,  program  differences  (j)  <  .01),  checkrlde  differences  ( p  <  .001),  and  the 
Program-by-Checkride  Interaction  (jp  <  .001)  were  all  significant.  As  can  be 
seen  In  Figure  7,  the  Program  B  students  clearly  had  the  lower  error  rates, 
with  the  Interaction  due  to  the  marked  divergence  in  performance  between  the 
two  programs  on  Checkride  3. 


TABLE  8.— SUMMARY  OF  ANOVA  FOR  THE  FIVE  MANEUVERS  PREVIOUSLY 
EXCLUDED  IN  THE  ANALYSIS  OF  SUBSET  II 


Source 

df 

Mean 

square 

F_ 

£ 

Program  (P) 

1 

5148. 

11.40 

<.01 

Between  error 

31 

451.6 

Checkrlde  (C) 

2 

1789. 

13.76 

<.001 

P  x  C 

2 

1081. 

8.32 

<.001 

Within  error 

62 

130.0 

A  question  naturally  arises  as  to  v^ether  the  10  subjects  available  from 
Program  B  were  representative  of  the  Program  B  group  as  a  whole.  To  answer 
this  question,  three  additional  analyses  were  completed.  In  the  first,  total 
error  percentages  by  checkrlde  for  the  r °  Program  B  students  used  above  were 
compared  with  those  of  the  remaining  8  Program  B  subjects  for  Subset  I  tasks, 
excluding  Traffic  Pattern,  Controlled,  as  before.  In  a  second  analysis,  a 
similar  comparison  was  made  of  Subset  II  tasks,  excluding  the  five  tasks 
described  previously.  In  the  third,  the  analysis  was  repeated  using  Subset 
III  tasks  (only  Checkrldes  3  and  4  Included  Subset  III  maneuvers).  The  ANOVA 
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for  repeated  observations,  adapted  for  groups,  of  unequal  size,. was  used  In 
each  analysis.  In  no  case  did  the  difference  between  subgroups  in  Program  0, 

nor  the  Subgroup-by-Checkride  interaction,  even  approach  significance.  That 
is,  the  10  subjects  used  in  the  comparison  with  Program  A  students  were  com¬ 
parable  on  all  other  PPDR  measures  to  the  8  Program  B  subjects  who  were 
excluded  from  the  comparison  with  Program  A.  The  conclusion  Is  that  the 
superiority  found  earlier  of  the  10  Program  B  students  over  the  23  in  Program 
A  was  due  to  Program  B  characteristics  as  a  whole,  and  not  to  a  bias  In  the 
selection  of  the  10  students  In  Program  B. 


Subset  III.  The  basic  ANOVA  completed  for  task  Subsets  I  and  II  was 
repeated  for  Subset  III,  although  only  Checkrldes  3  and  4  could  be  Included 
since  Subset  III  measures  were  obtained  only  on  these  rides.  All  24  students 
in  Program  A  and  all  18  In  Program  B  were  Included  in  the  analysis.  The 
results  are  summarized  In  Table  9.  The  mean  error  percentages  are  depicted  In 
Figure  8.  No  f_  was  statistically  significant,  although  the  Fs  of  3.54  and 
3.65  for  Program  and  Checkrlde,  respectively,  approached  the  value  of  4.08 
required  for  significance  at  the  .05  level.  As  can  be  seen  in  Figure  8, 
Program  A  showed  some  advantage  on  both  checkrldes  and  progress  occurred  for 
both  programs  from  the  third  to  the  fourth  checkrlde.  Nevertheless,  the 
variability  within  each  program  was  considerable  on  Subset  III  tasks,  and,  as 
a  consequence,  the  apparent  mean  differences  represented  in  Figure  8  were  not 
statistically  significant. 

Overall  Flight  Performance.  To  summarize  relative  training  efficiency 
over  all  task  subsets  for  the  two  programs.  It  would  appear  that  there  was  no 
clearcut  efficiency  advantage  for  either  program.  However,  progress  during 
training,  as  reflected  by  PPDR  error  rates  on  the  various  checkrldes,  appeared 
somewhat  more  rapid  for  Program  B  than  for  Program  A,  though  Program  A  exhib¬ 
ited  a  tendency  toward  better  performance  than  Program  B  on  Subset  III  tasks. 
These  data  favoring  Program  B  would  tend  to  lend  support  for  the  efficiency 
advantage  found  for  Program  B  with  reference  to  flight  hours. 


TABLE  9 

.  —SUMMARY 

OF  ANOVA  FOR  TASK 

SUBSET  III 

Mean 

Source 

df 

square 

¥_ 

£ 

Program  (P) 

1 

522.5 

3.54 

NS 

Between  error 

40 

147.4 

Checkrlde  (C) 

1 

593.3 

3.65 

NS 

P  x  C 

1 

0.62 

<1 

NS 

Within  error 

40 

162.6 

WRITTEN  QUIZZES  DURING 

TRAINING. 

A  final  aspect 

of  training 

efficiency 

that  related  to  academte  performance  during  training.  While  of  Interest,  the 
practical  cost  connotations  of  any  differences  In  this  area  would  seem  con¬ 
siderably  less  than  those  for  the  fl  ight  area  just  discussed.  As  was  pointed 
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FIGURE  8. -MEAN  PERCENT  ERROR  FOR 
SET  III  PPDR  MEASURES. 
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out  earlier,  students  In  Programs  A  and  B  had  generally  the  same  grades  on  the 
E-RAU  final  written  examination  and  on  the  FAA  Private  Pilot-Airplane  Written 
Test.  It  Is  apparent,  however,  from  results  for  the  six  academic  quizzes 
given  during  training,  as  shown  In  Table  10,  that  test  grades  during  training 
were  different  between  the  two  groups.  Program  B's  grades  were  consistently 
Inferior  to  Program  A's,  and  Program  B  was  consistently  more  variable.  The 
means  In  Table  10  were  compared  by  a  repeated  measures  ANOVA,  adapted  as 
before.  The  results  are  summarized  In  Table  11.  The  overall  program  differ¬ 
ences  were  highly  significant  (£  <  .001)  and  the  Prog ram- by-Test  Interaction 
(p  <  .05)  Indicates  that  the  magnitude  of  differences  shown  In  Table  11  for 
trie  last  three  tests  was  significantly  greater  than  It  was  on  the  first  three 
tests. 


TABLE  10.— MEANS  (M)  AND  STANDARD  DEVIATIONS  (SD) 
FOR  THE  SIY  PERIODIC  WRITTEN  TESTS 


Program 

Test: 

N 

1 

M  SD 

M 

2 

SD 

3 

M 

SD 

A 

24 

86.2  9.2 

74.0 

12.5 

96.2 

9.2 

B 

13 

80.0  15.7 

71.7 

18.7 

92.8 

9.9 

Program 

Test: 

N 

4 

M  SD 

M 

5 

SD 

6 

M 

SD 

A 

24 

92.1  8.1 

89.3 

10.4 

87.8  11.2 

B 

lb 

79.9  13.1 

77.1 

12.2 

71.4  18.1 

TABLE  11.— 

SUMMARY  OF  ANOVA  FOR  THE  PERIODIC 
WRITTEN  TESTS 

Source 

df 

Mean 

square 

F 

£ 

Program  (P) 
Between  error 

1 

40 

5003. 

356.1 

14.05 

<.001 

Test  (Te) 

P  x  Te 

Within  error 

5 

5 

200 

2070. 

333.1 

115.2 

17.97 

2.89 

<.001 

<.05 

From  these  results,  It  seems  clear  that  students  In  Program  A  consistently 
performed  better  than  those  In  Program  B  during  the  course  of  their  academic 
Instruction.  Thus,  Program  A  can  be  viewed  as  relatively  more  advantageous 
with  reference  to  In-process  academic  progress.  Yet,  as  reflected  by  the  end- 
of-course  measures  used  (E-RAU  final  examination  and  FAA  Private  Pilot- 
Airplane  Written  Test),  there  was  no  difference  between  groups  at  the  end  of 
training.  Thus,  the  In-process  academic  efficiency  advantage  shown  by  Program 
A  would  seem  of  no  particular  practical  consequence. 

3.  SELF-ASSESSMENT  OF  PERFORMANCE. 


The  third  area  of  results  of  concern  Is  that  dealing  with  students'  abilities 
to  make  accurate  assessment  of  their  own  performance.  Each  student's  predic¬ 
tion  of  the  number  of  errors  he  would  make  on  the  fourth  checkrlde,  and  his 
evaluation  of  his  performance  after  that  checkrlde,  were  ascertained  as  des¬ 
cribed  In  Section  II.  The  primary  concern  was  the  degree  of  accuracy  In 
either  case.  That  Is,  how  accurately  can  students  anticipate  the  quality  of 
their  performance,  and  how  accurately  can  they  evaluate  how  they  actually 
performed?  Answers  to  these  questions  are  pertinent  to  any  consideration  that 
pilots  be  permitted  to  decide  for  themselves  when  they  need  refresher  training. 

The  data  were  analyzed  by  correlating  predictions  and  self-evaluations  with 
the  actual  numbers  of  errors  recorded  on  the  PPDR  during  the  fourth  checkrlde. 
In  computing  the  correlations,  the  subjects  In  the  two  programs  were  treated 
as  a  single  group.  Because  of  missing  data,  only  37  subjects  were  available 
for  correlations  Involving  predictions,  self-evaluations,  and  actual  errors  on 
28  maneuvers  combined.  (One  of  the  original  29  maneuvers,  Traffic  Pattern, 
Controlled,  was  omitted  because  too  few  students  had  an  opportunity  to  perform 
It.)  With  reference  to  the  ability  of  the  students  to  predict  how  they  would 
perform  on  the  fourth  checkrlde  prior  to  that  checkrlde,  there  was  no  correla¬ 
tion  between  such  predictions  and  subsequent  performance  (£  *  0.00).  Neither 
was  there  any  reliable  correlation  between  their  self-evaluation  after  the 
checkrlde  and  the  error  made  on  the  checkrlde  {jr  -  +.04).  In  other  words, 
actual  performance  was  not  related  either  to  predictions  or  to  sel f- 
eval uatlons. 

Nevertheless,  the  correlations  were  repeated  separately  for  each  of  26 
maneuvers.  (Two  additional  maneuvers,  Conducting  Engine  Run-Up/Before  Takeoff 
Check,  and  Radio  Communication,  were  omitted  because  no  student  made  any 
errors  on  them.)  For  pre-checkrlde  predictions,  the  jrs  with  actual  perfor¬ 
mance  ranged  from  -.24  to  +.22,  with  a  mean  of  zero.  For  self-evaluations, 
the  range  was  from  -.28  to  +.43,  with  a  mean  of  +.05.  The  range  and  mean  of 
rs  for  predictions  and  self-evaluations  both  are  within  chance  expectations 
7or  distributions  of  samplers  when  no  relationship  actually  exists. 

The  data  were  organized  differently  for  a  further  analysis  of  the  accuracy  of 
predictions  and  self-evaluations.  Instead  of  pairing  values  for  Individuals 
and  computing  rs  across  Individuals  as  above,  group  means  of  predictions  and 
of  self-evaluations  for  each  maneuver  were  correlated  with  mean  actual  errors 
for  each  maneuver.  In  this  case,  only  the  Traffic  Pattern,  Controlled  maneu¬ 
ver  was  omitted,  thus  leaving  some  28  maneuvers  on  which  the  correlations  were 
based.  Moderate  correlations  were  obtained;  r_  =  +.42  for  mean  predictions 
with  mean  actual  errors,  and  r_  -  +.48  for  mean  self-evaluations  with  mean 
actual  errors.  These  rs,  which  are  not  as  subject  to  sampling  errors  as  those 
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computed  across  subjects,  Indicate  that,  as  a  group,  the  students  could 
discriminate  moderately  well  the  extent  of  relative  differences  In  difficulty 
they  would  encounter  on  various  maneuvers,  even  though  they  could  not  predict 
how  they  would  actually  perform  as  Individuals.  Hence,  a  related  question  was 
pursued:  Do  Individual  students  differ  In  the  extent  to  which  they  can 

discriminate  relative  maneuver  difficulties? 

To  establish  the  presence  of  Individual  differences  In  ability  to  assess  rela¬ 
tive  maneuver  difficulties,  It  Is  necessary  only  to  show  that  £s  across  maneu¬ 
vers,  computed  separately  for  each  student  Instead  of  for  means  of  the  group 
as  a  whole,  reliably  discriminate  among  Individuals.  The  data  needed  for 
reliability  analyses  were  not  available,  but  an  alternate  approach  established 
that  substantial  reliability  existed.  Specifically,  If  the  two  sets  of  _r  mea¬ 
sures  In  question,  those  between  predictions  and  actual  errors,  and  those 
between  self-evaluations  and  actual  errors,  are  themselves  correlated,  a  mini¬ 
mum  reliability  for  each  set  can  be  inferred.  That  Is,  no  correlation  between 
variables  can  exceed  the  geometric  mean  of  the  reliability  coefficients  for 
the  measures,  so  the  geometric  mean  of  the  reliabilities  of  the  measures 
Involved  must  be  at  least  as  high  as  their  correlation.  Of  course,  the  geo¬ 
metric  mean  will  be  actually  greater  than  a  nonzero  correlation  of  variables 
to  the  extent  two  variables  measure  Independent  domains.1 

Accordingly,  the  separate  subject  rs,  computed  across  maneuvers  for  predic¬ 
tions  and  self-evaluations  with  actual  errors,  were  transformed  to  Fisher  zs 
and  then  correlated  across  subjects.  An  £  of  .62  was  obtained,  which  Ts 
significant  beyond  the  .001  level.  Thus,  taking  .62  as  a  valid  estimate  of 
the  correlation  between  the  two  sets  of  rs,  the  geometric  mean  of  the  relia¬ 
bilities  of  the  two  sets  must  be  around  .60  or  higher.  Therefore,  the  Indivi¬ 
dual  _rs  across  maneuvers  reliably  discriminate  among  students,  meaning  that 
some  students  are  better  able  than  others  to  anticipate  difficulties  they 
will  have  with  various  maneuvers  and  to  evaluate  how  they  actually  performed 
on  them. 

These  data  offer  little  encouragement  regarding  the  use  of  pilots'  predictions 
or  self-evaluations  of  current  performance  as  bases  for  recurrent  training. 
Some  students  were  able  to  make  reasonable  assessments,  but  as  a  group,  the 
students'  predictions  and  self-evaluations  were  essentially  worthless.  There 
Is  no  way  at  present  to  Identify  beforehand  which  students  among  the  group 
make  reasonable  self-assessments.  Of  course,  It  must  be  kept  In  mind  that 
these  students  represent  relatively  low  points  on  the  pilot  experience  con¬ 
tinuum.  It  Is  possible  that  as  their  experience  level  Increases,  their 
Insight  Into  their  own  performance  capabilities  and  recurrent  training  needs 
may  Improve.  Further  pursuit  of  this  problem  should  seek  to  Identify  charac¬ 
teristics  of  "good"  self-assessors,  as  well  as  to  determine  If  the  same 
general  patterns  of  accuracy  and  Inaccuracy  hold  for  more  experienced  pilots. 

4.  STUDENTS'  PERCEPTIONS  OF  TRAINING. 

The  final  results  of  concern  are  those  relating  to  the  students'  views  of  the 
training  they  received,  Its  strong  and  weak  points,  and  the  manner  In  which 


^Readers  not  familiar  with  correlational  statistics  are  referred  to 
McNemar  (1969,  p.  171£)  for  a  detailed  discussion  of  the  concepts  in  this 
paragraph. 


34 


that  training  affected  them.  Data  regarding  students'  perceptions  of  training 
were  collected  primarily  with  the  Student  Opinion  Survey  described  In  Section 
II.  However,  two  other  Instruments,  the  Student  Pre-Check  Questionnaire  and 
the  Student  Post-Check  Questionnaire,  also  yielded  data  related  to  students' 
perceptions  of  training.  While  the  principal  purpose  of  the  last  two  Instru¬ 
ments  was  to  evaluate  the  ability  of  students  to  assess  their  flight  skills  as 
discussed  In  the  preceding  section,  they  also  revealed  something  of  the 
students'  confidence  In  themselves  and  their  ability  to  perform,  as  explained 
1  ater . 

STUDENT  OPINION  SURVEY  DATA.  Items  on  the  Student  Opinion  Survey  covered  a 
variety  of  content  and  thus  did  not  allow  derivation  of  a  meaningful  overall 
opinion  Index.  Two  groups  of  Items  formed  homogenous  sets,  however,  while  the 
remaining  Items  tapped  varied  reactions  to  and  satisfaction  with  training. 

The  homogeneous  sets  are  discussed  first. 

Item  18  of  the  Survey  had  two  subsections,  one  to  measure  reactions  toward 

training  received  in  the  aircraft  and  the  other  a  comparable  measure  of  reac¬ 
tions  toward  training  received  on  the  ground.  Each  subsection  provided  for  11 
responses.  Adapted  reproductions  of  the  scales  for  the  two  subsections  are 
shown  In  Figures  9  and  10.  The  words  at  the  left  and  right  of  each  scale 
represent  bipolar  extremes  of  an  evaluative  dimension,  and  students  were  to 
circle  a  number  from  one  to  six  on  each  scale  according  to  the  manner  and 

extent  to  which  that  dimension  described  their  training.  A  mean  for  each 

group  was  obtained  for  each  scale,  based  on  the  numbers  circled.  The  means 
for  Programs  A  and  B  students  are  plotted  In  Figures  9  and  10. 

Except  for  the  dimensions  Hard-Easy  and  Harrled-Lel surely,  positive  reactions 
toward  training  would  be  Indicated  by  means  toward  the  left  side  of  each 
figure.  With  reference  to  training  in  the  aircraft  (Figure  9),  both  tracks 
showed  positive  reactions,  with  Program  B  perhaps  being  slightly  more  positive 
overall.  The  only  statistically  significant  difference,  however,  was  for 
Married-Leisurely,  which  Program  B  tended  to  mark  more  toward  the  Leisurely 
end. 

Reactions  to  ground  training  (Figure  10)  were  somewhat  less  positive  overall, 
but  still  favorable.  There  was  no  general  trend  of  differences  between 
programs,  and  no  difference  was  statistically  significant. 

The  second  set  of  homogeneous  Items  was  the  difficulty  rating  for  the  29 
maneuvers  listed  In  Item  19  of  the  Student  Opinion  Survey.  Students  were  to 
rate  the  difficulty  they  experienced  In  learning  each  maneuver,  using  a  scale 
from  1  (no  difficulty)  to  6  (extreme  difficulty).  Using  3.5,  the  midpoint 
between  1  and  6,  as  a  dividing  point  between  relative  ease  and  relative  dif¬ 
ficulty  In  learning,  both  Program  A  and  Program  B  reported  only  two  maneuvers 
as  being  relatively  difficult:  (1)  Performing  Accelerated  Stalls;  and  (2) 
Making  Crosswind  Landings  (Uncontrolled  Field).  When  te  were  computed  sepa¬ 
rately  by  maneuver.  Program  B  reported  significantly  less  difficulty  In 
learning  3  of  the  29  maneuvers:  (1)  Performing  Engine  Failure  During  Flight 
Procedures  (j>  <  .02);  (2)  Performing  Forced  Landing  Procedures  (j>  <  .05);  and 
(3)  Performing  a  Magnetic  Compass  Turn  under  the  Hood  (j)  <  .05).  Furthermore, 
Program  B  reported  lower  mean  difficulty  rating  than  Program  A  on  26  of  the  29 
maneuvers.  However,  means  for  ratings  of  all  29  maneuvers  combined  (M  =  2.80 
for  Program  A;  and  M  =  2.52  for  Program  B)  were  not  significantly  different. 
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FEELINGS  TOWARD  TRAINING  RECEIVED  IN  THE  AIRCRAFT. 


FEELINGS  TOWARD  TRAINING  RECEIVED  ON  THE  GROUND. 


The  conclusion  to  be  drawn  is  that  students  In  both  programs  viewed  the  maneu¬ 
vers  as  relatively  easy  to  learn  on  the  whole,  and  any  overall  differences,  if 
present,  are  quite  small. 

Because  the  remaining  items  of  the  Student  Opinion  Survey  did  not  lend  them¬ 
selves  to  meaningful  combinations  for  analysis,  t  tests  were  run  for  each  Item 
separately.  Only  three  £s  were  significant:  (IT  Program  A  students  were  more 
inclined  to  report  that  their  supervisors  believed  that  their  training  dis¬ 
tracted  them  from  their  jobs  (p  <  .01);  (2)  Program  B  students  would  have 
liked  more  frequent  flights  during  training  (£  <  .05);  and  (3)  Program  B  stu¬ 
dents  reported  having  less  trouble  remembering  what  they  had  learned  on  pre¬ 
vious  flights  (£  < .05 ) .  On  these  3  and  the  remaining  16  general  Items  on  the 
Survey,  reactions  toward  training  were  typically  positive. 

Before  turning  to  the  self-assessment  data,  it  should  be  pointed  out  that  the 
significant  ts  reported  above,  except  for  those  concerned  with  maneuvers, 
related  directly  to  the  relative  amount  of  distribution  of  training  over  time 
experienced  by  Programs  A  and  B,  respectively.  Program  B  considered  their 
aircraft  training  more  leisurely,  they  were  less  distracted  from  their  jobs, 
they  would  have  liked  more  frequent  flights,  and  they  remembered  more  from  one 
flight  to  the  next. 

SELF-ASSESSMENT  DATA.  The  self-assessment  data  were  of  two  kinds:  (1)  pre- 
dlctions  of  one's  own  performance  on  the  fourth  checkrlde  In  terms  of  numbers 
of  errors  the  student  expected  to  make  on  each  of  29  maneuvers;  and  (2)  self- 
evaluations  In  terms  of  numbers  of  errors  each  student  thought  he  made  on  each 
of  the  29  maneuvers  during  the  fourth  checkrlde.  As  explained  earlier,  these 
data  were  collected  primarily  for  another  purpose;  but  they  also  reveal  some¬ 
thing  regarding  the  confidence  each  student  had  in  himself,  and,  by  impli¬ 
cation,  his  assessment  of  the  adequacy  of  training  received. 

In  addition  to  the  analyses  of  these  data  discussed  earlier  in  this  section, 
the  means  of  pre-checkrlde  predictions  and  of  post-checkrlde  self-evaluations 
were  compared  for  the  two  programs  on  each  of  the  29  maneuvers.  For  prediction 
scores.  Program  B  as  a  group  predicted  fewer  errors  for  themselves  than  Pro¬ 
gram  A  did  on  each  of  the  29  maneuvers;  and  the  difference  was  statistically 
significant  (j>  <  .05)  for  12  of  the  29  maneuvers.  For  post-checkrlde  data, 
Program  B's  self-evaluations  showed  fewer  mean  errors  on  27  of  29  maneuvers; 
and  the  differences  from  Program  A  were  statistically  significant  for  9  of  the 
29  maneuvers. 

The  results  of  these  analyses  are  generally  consistent  with  those  pertaining 
to  reported  difficulty  In  learning  maneuvers  which  were  discussed  In  the  pre¬ 
ceding  section  (Item  19  on  the  Student  Opinion  Survey) .  The  results  of  the 
analyses  are  more  clear-cut,  however,  and  less  ambiguous  regarding  perceptions 
of  the  value  of  training.  Whereas  one  might  have  difficulty  learning  regard¬ 
less  of  the  quality  of  training,  confidence  that  one  can  perform  with  few 
errors  speaks  directly  to  perceived  quality  of  training.  The  data  from  self- 
assessments  suggest  that  Program  B  students  had  more  confidence  In  themselves. 
If  so,  It  may  be  Inferred  that  they  also  had  more  confidence  In  their  training. 
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IV.  CONCLUSIONS 


The  major  findings  of  the  present  study  are  discussed  in  the  following 
paragraphs.  As  in  the  Results  section,  the  discussions  are  divided  Into  four 
major  segments:  (1)  training  effectiveness,  (2)  training  efficiency,  (3) 
assessment  of  performance,  and  (4)  perception  of  training. 

1.  TRAINING  EFFECTIVENESS. 

In  general,  with  respect  to  the  overall  performance  of  students  at  the  end  of 
ground  and  flight  training,  there  were  no  significant  differences  between 
Programs  A  and  B.  The  academic  performance  of  students  in  the  two  programs, 
as  measured  by  the  ground  school  final  exam  and  the  FAA  Private  Pilot-Airplane 
Written  Test,  did  not  differ.  Nor  were  there  any  overall  differences  on  the 
measures  of  flying  proficiency  taken  at  the  end  of  flight  training— 1  .e.,  the 
fourth  PPDR  checkrlde  and  the  FAA  Private  Pilot-Airplane  Flight  Test. 

When  performance  was  considered  with  respect  to  the  separate  PPDR  task  subsets 
(I,  II,  and  III)  on  the  fourth  checkrlde,  however,  certain  patterns  of  dif¬ 
ferences  did  appear.  To  begin  with,  students  In  both  programs  tended  to  do 
better  on  tasks  in  Subset  I  than  on  tasks  in  Subset  II,  and  better  on  tasks  in 
Subset  II  than  on  those  In  Subset  III.  Students  In  Program  B,  however,  made 
fewer  errors,  relative  to  students  in  Program  A,  on  tasks  in  Subsets  I  and  II, 
while  students  In  Program  A  tended  to  make  fewer  errors  on  tasks  In  Subset 
III. 

This  Interaction  between  programs  and  task  subsets  served  to  reduce  or  mask 
differences  between  the  programs  when  overall  checkrlde  performance  (l.e., 
performance  summarized  across  all  tasks)  was  considered.  That  is,  the 
superiority  of  Program  B  on  Subsets  I  and  II  was  offset  or  counterbalanced  by 
the  superiority  of  Program  A  on  Subset  III.  The  finding  of  an  Interaction 
between  task  subsets  and  programs  Is  not  surprising,  since  the  results  of  past 
research  have  Indicated  that  the  nature  of  the  Impact  of  different  distribu¬ 
tions  of  training  tends  to  be  specific  to  the  characteristics  of  the  tasks 
being  learned  (for  discussion  of  relevant  points,  see  Appendix  A), 

It  may  be  possible  that  the  more  distributed  training  regimen  of  Program  B  Is 
advantageous  for  the  learning  of  tasks  In  Subsets  I  and  II,  which  tend  to  be 
primarily  psychomotor  skill  tasks.  In  contrast,  Subset  III  tasks  are  much 
more  heavily  cognitive  and  procedural  In  nature,  and  the  closer  temporal  rela¬ 
tionship  between  flight  training  and  checkrlde  for  Program  A  might  be  expected 
to  result  in  a  lesser  amount  of  forgetting.  Also,  It  Is  worth  noting  that  the 
application  of  what  Is  learned  In  the  classroom  to  flight  is  of  more  direct 
nature  for  Subset  III  tasks,  and  the  shorter  time  between  classroom  learning 
and  checkrlde  would  also  minimize  the  amount  of  forgetting  for  Program  A 
students. 

Such  speculations  notwithstanding,  however,  with  respect  to  training  effec¬ 
tiveness,  It  can  be  concluded  that  the  different  distribution  of  training  time 
had  no  significant  or  practical  impact  on  the  overall  academic  or  flight 


performance  of  the  students.  Students  in  both  groups  clearly  were  able  to 
perform  well  enough  to  meet  the  minimum  requirements  for  their  private  pilot 
certificates  at  the  end  of  their  training.  The  differences  in  relative  per¬ 
formance  between  programs  on  task  subsets  should  be  taken  into  consideration, 
however,  when  student  pilot  training  is  being  planned. 

2.  TRAINING  EFFICIENCY. 

Training  efficiency  was  assessed  in  three  ways:  (1)  the  number  of  flight  and 
oral  hours  spent  by  students  in  various  training  activities,  (2)  the  patterns 
of  the  students'  progress  through  flight  training  as  measured  on  the  four 
checkrides;  and  (3)  the  patterns  of  progress  of  the  students  through  ground 
school  as  measured  on  the  six  written  quizzes. 

Students  In  Program  B  received  fewer  total  flight  hours  during  their  training 
than  did  students  in  Program  A.  This  difference  In  total  time  was  entirely 
due  to  a  substantial  difference  in  dual  flight  time;  there  was  no  such  dif¬ 
ference  in  solo  flight  time.  Other  significant  differences  in  flight  time, 
when  they  occurred,  also  favored  Program  B— l.e.,  students  In  Program  B  flew 
fewer  hours  prior  to  Checkrides  3  and  4.  Thus,  with  respect  to  flight  hours, 
it  can  be  concluded  that  Program  B  was  more  efficient  than  Program  A.  Since 
the  major  difference  was  in  dual  flight  hours,  where  Instructor  costs  are 
added  to  flight  costs,  this  difference  In  efficiency  is  of  substantial 
practical  Importance. 

The  pattern  of  Program  B  tending  to  be  more  efficient  is  also  apparent  in 
measures  of  the  flight  progress  of  the  students  through  the  flight  training 
programs— i .e.,  In  the  patterns  of  the  PPDR  scores  obtained  on  the  four 
checkrides.  When  significant  differences  were  observed  between  programs  on 
any  of  the  task  subsets,  they  were  almost  always  in  favor  of  Program  B. 
Performance  on  Subset  II,  for  example,  was  better  for  Program  B  on  all  three 
checkrides  (2,  3,  and  4)  on  which  this  subset  was  measured.  Additionally,  the 
performance  of  students  In  Program  B  was  better  on  tasks  in  Subset  I  on  three 
of  the  four  checkrides  (2,  3,  and  4).1  Thus,  students  In  Program  B  tended  to 
fly  less,  at  least  with  their  instructors,  and  tended  to  perform  better  at 
various  flight  checkpoints  during  the  program.  TheLt  is,  they  appeared  to 
learn  more  rapidly,  with  less  effort,  during  training.2 


*As  a  possible  exception  to  the  trend  that  Progam  B  was  more  efficient, 
It  was  observed  that  the  average  performance  of  Program  A  was  slightly  better 
on  Subset  III  (Checkrides  3  and  4),  though  this  difference  was  not  statisti¬ 
cally  significant. 

2 

Before  leaving  the  discussion  of  PPDR  scores  on  the  four  checkrides.  It 
should  be  noted  that  scores  on  the  various  task  subsets  (I,  II,  and  III) 
usually  Improved  across  checkrides,  indicating  that  students  in  both  programs 
were  learning  to  perform  them  better.  This  change  in  performance  across 
checkrides  demonstrates  that  the  PPDP  was  sensitive  to  variation  in  an  Indi¬ 
vidual's  proficiency  over  time.  Thus,  the  utility  of  the  PPDR  for  assessing 
retention  (variance  in  proficiency  across  time)  is  also  Illustrated. 
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The  relative  efficiency  advantage  of  Program  B  over  A  holds  true  only  for 
flight  training,  however.  When  the  pattern  of  academic  performance  on  the  six 
written  quizzes  during  ground  school  was  examined,  it  revealed  that  students 
in  Program  A  scored  higher  than  those  in  Program  B  on  all  quizzes,  especially 
the  last  three.  Thus,  the  patterns  of  progress  differed  between  students  in 
the  two  ground  school  programs.  Students  in  Program  B  tended  to  perform  less 
well  during  the  ground  school  course,  but  at  the  end  of  training,  as  reported 
under  training  effectiveness,  did  just  as  well  as  students  in  Program  A  on  the 
final  ground  school  exam  and  the  FAA  written  test.  Whether  this  "catching  up" 
was  due  to  cramming  or  to  their  benefiting  more  from  their  flight  instruction 
could  not  be  determined.  Nevertheless,  the  Program  B  students  did  catch  up 
with  the  result  that  there  was  no  difference  between  the  groups  on  the  two 
end-of-course  academic  tests. 

In  summary,  distributing  private  pilot  training  over  longer  periods  of  calen¬ 
dar  time  appears  to  improve  the  efficiency  of  flight  training  to  a  certain 
degree,  but  may  serve  to  lower  the  efficiency  of  ground  school.  It  may  well 
be  possible  to  adapt  private  pilot  training  so  as  to  take  advantage  of  posi¬ 
tive  aspects  of  both  concentrated  and  distributed  training  as  they  affect 
efficiency.  Practice  in  flight  skills  could  be  distributed,  for  example, 
wh-'le  blocks  of  ground  training  could  be  concentrated  and  provided  at  optimal 
points  so  as  to  permit  integration  of  ground  and  flight  instruction.  It  would 
appear  that  the  only  efficiency  difference  of  practical  consequence  is  that 
relating  to  the  lesser  average  flight  time  received  by  the  students  in  Program 
B.  The  approximate  10  percent  reduction  in  flying  hours  of  Program  B  over  A 
is  a  matter  of  both  financial  and  fuel  savings  concern. 

3.  ASSESSMENT  OF  PERFORMANCE. 

Using  the  pre- flight  questionnaires  employed  in  this  study,  the  students, 
taken  as  a  group,  were  not  able  to  predict  the  number  of  errors  they  would 
make  on  the  fourth  checkrlde.  Some  students,  however,  were  better  than  others 
at  predicting  their  performance.  That  is,  their  predictions  correlated  to  a 
greater  extent  with  their  actual  performance  on  checkrldes  than  did  the  pre¬ 
dictions  of  other  students. 

Similarly,  as  a  general  rule,  the  students  were  not  able  to  evaluate  their  own 
performance  after  they  had  completed  the  fourth  checkrlde.  As  with  pre¬ 
dicting,  however,  some  students  were  better  than  others  at  evaluating  their 
performance.  In  large  part,  these  students  were  the  same  ones  who  were  better 
at  predicting  their  performance.  Unfortunately,  there  was  no  way  to  Identify 
beforehand  which  students  would  be  better  able  to  predict  and  evaluate  their 
own  performance. 

The  purpose  of  collecting  these  data  was  to  develop  a  methodology  for  evalua¬ 
ting  the  capabilities  of  pilots  to  assess  their  own  performance.  Such  capa¬ 
bilities  are  needed  to  Identify  accurately  and  efficiently  the  areas  in  which 
a  certificated  pilot  feels  he  needs  recurrent  training.  As  such,  the  method¬ 
ology  was  designed  mainly  to  be  employed  In  the  second  phase  of  the  present 
study.  The  students  will  be  given  similar  pre-  and  post- flight  questionnaires 
before  and  after  each  of  the  checkfllghts  that  will  be  conducted  in  the  later 
long-term  retention  phase  (shown  In  Figure  2  in  the  Methods  section).  During 
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the  second  phase,  determinations  will  be  made  of  whether  the  students  who  were 
better  able  to  predict  and  evaluate  their  performance  can  retain  these  capa¬ 
bilities  over  time.  Patterns  of  change  over  time  within  these  capabilities 
for  all  pilots  will  also  be  Investigated. 

In  summary,  the  ability  of  certificated  pilots  to  assess  their  own  performance 
accurately  remains  to  be  demonstrated.  Preliminary  findings  show  that,  as  a 
general  rule,  student  pilots  are  not  able  to  predict  or  evaluate  checkrlde 
performance.  While  some  student  pilots  are  able  to  predict  and  evaluate 
better  than  others,  there  Is  no  way  at  present  to  determine  beforehand  which 
students  have  such  capabilities.  Research  during  the  second  phase  of  the  pre¬ 
sent  study  will  address  these  and  other  related  issues  in  an  attempt  to  gain  a 
systematic  understanding  of  the  self-assessment  problem. 

4.  PERCEPTION  OF  TRAINING. 

Based  on  their  general  response  to  the  Student  Opinion  Survey,  the  students  in 
both  programs  felt  very  positive  toward  their  flight  training,  with  those  in 
Program  B  being  slightly  more  positive  than  those  in  Program  A.  Students  in 
both  programs  also  felt  positive  about  their  ground  training,  but  less  so  than 
they  did  for  flight  training. 

With  respect  to  specific  survey  questions,  only  a  few  differences  occurred 
between  the  responses  of  students  in  the  two  programs.  As  might  be  expected 
because  of  Its  concentrated  nature,  students  In  Program  A  felt  that  their 
flight  training  was  more  harried  and  that  It  distracted  more  from  their  job. 
Students  In  Program  B  would  have  preferred  more  frequent  flight  lessons,  while 
students  In  Program  A  reported  more  trouble  in  remembering  what  was  learned. 
While  the  reason  for  their  trouble  in  remembering  Is  unclear.  It  may  have  been 
related  to  the  reduced  training  effectiveness  and  efficiency  observed  in 
Program  A. 

When  asked  to  rate  (on  the  Student  Opinion  Survey)  the  difficulty  of  the  tasks 
that  they  learned,  students  in  Program  B  consistently  (on  26  out  of  29  tasks) 
rated  tasks  as  being  less  difficult  when  compared  to  the  ratings  of  the  stu¬ 
dents  In  Program  A.  Similarly,  on  the  pre-  and  post-flight  questionnaires, 
students  In  Program  B  consistently  predicted  that  they  would  make  fewer  errors 
and,  after  the  checkrlde,  felt  that  they  had  made  fewer  errors  (even  though 
there  was  no  overall  difference  between  programs  In  actual  performance  on  the 
fourth  checkrlde) .  Thus,  It  can  be  concluded  that  students  In  Program  B  felt 
more  confident  In  their  flight  training.  As  a  group,  they  felt  they  had  less 
difficulty  learning  to  fly,  and  that  they  would  and  did  do  better  on  the 
fourth  checkrlde.  Flight  check  data  tended  to  substantiate  their  view. 

SUMMARY  OF  MAJOR  CONCLUSIONS. 

The  major  findings  just  discussed  are  summarized  in  Table  12.  In  general, 
these  results  suggest  that  the  lengthening  of  private  pilot  training  to  spread 
out  training  expenses  as  these  costs  rise  will  not  have  a  serious  Impact  on 
the  effectiveness  of  Instruction.  No  significant  differences  were  observed  In 
overall  performance  of  the  students  at  the  end  of  ground  and  flight  training. 
Certain  differences  In  effectiveness  were  observed  with  respect  to  particular 
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categories  of  tasks,  however,  and  they  should  be  taken  Into  consideration  In 
the  conduct  and  evaluation  of  private  pilot  training.  But,  Insofar  as  the 
Phase  I  results  are  concerned,  there  were  no  practical,  comprehensive  dif¬ 
ferences  In  Instructional  effectiveness  between  the  two  programs. 


TABLE  12. —SUMMARY  OF  MAJOR  RESULTS 


Findings 

1.  TRAINING  EFFECTIVENESS 

A.  Fourth  fl  Ight  checkrlde 
(PPDR) 

1. 

No  overall  difference  between 
programs. 

2. 

Fewer  errors  were  made  by  students 
in  both  programs  on  Task  Subset  I 
than  II,  and  fewer  on  II  than  III. 

3. 

Program  B  did  better  than  A  on 
Subsets  I  and  II,  but  A  did  better 
than  B  on  Subset  III. 

B.  FAA  Private  Pilot- 
Airplane  Flight  Test 

1. 

No  overall  differences  between 
programs. 

C.  Ground  school  final  exam 

1. 

No  overall  difference  between 
programs. 

D.  FAA  Private  Pilot- 
Airplane  Written  Test 

1. 

No  overall  difference  between 
programs. 

2.  TRAINING  EFFICIENCY 

A.  Flight  and  oral  hours  1.  Program  B  accumulated  fewer  total 

dual  hours. 

2.  Program  B  also  accumulated  fewer 
hours  prior  to  Checkrldes  1  and  3. 

3.  There  was  a  larger  variance  In 
flight  hours  among  students  In 
Program  B,  especially  solo  hours. 


(Continued) 
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TABLE  12  (Continued) 


Findings 


B.  Flight  checkrldes 
(PPDR;  Task  Subset  I) 

1. 

No  overall  difference  between 
programs. 

2. 

Performance  of  students  In  both 
programs  Improved  across  check- 
rides  (1,  2,  3,  4). 

3. 

Program  A  did  marginally  better 
than  B  on  the  first  checkride,  but 
B  did  better  on  the  other  three 
checkrldes,  especially  the  third 
one. 

C.  Flight  checkride 

(PPDR;  Task  Subset  II) 

1.  Program  B  did  better  than  A  on 
three  checkrldes. 

2.  Performance  of  students  in  both 
programs  tended  to  improve  over 
checkrldes  (2,  3,  4). 

D.  Six  written  quizzes 

1.  Program  A  did  better  than  B  across 
all  quizzes,  especially  the  last 
three  quizzes. 

3.  ASSESSMENT  OF  PERFORMANCE 

A.  Relation  of  pre- flight 
predictions  to  actual 
performance 

1.  As  a  general  rule,  students  were 
not  able  to  predict  their  perfor¬ 
mance.  Some  students,  however, 
were  better  than  others  at 
predicting. 

B.  Relation  of  post- flight  1.  As  a  general  rule,  students  were 

evaluations  to  actual  not  able  to  evaluate  their  own 

performance  performance.  Some  students,  how¬ 

ever,  were  better  than  others  at 
eval uatlng. 


(Continued) 
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TABLE  12. 


(Continued) 


Findings 


4.  PERCEPTION  OF  TRAINING 

A.  Student  Opinion 
Survey 


1.  In  general ,  students  In  both  pro¬ 
grams  felt  positive  toward  flight 
training;  those  In  Program  B  were 
slightly  more  positive. 

2.  Students  In  both  programs  were  less 
positive  toward  ground  training 
than  flight  training. 

3.  Students  In  Program  A  felt  training 
was  more  harried  and  that  It 
distracted  them  more  from  their 
job.  They  also  felt  they  had  more 
trouble  remembering  what  was 
1  earned . 

4.  Students  In  Program  B  would  have 
preferred  more  frequent  flight 
1 essons. 

5.  Program  B  reported  less  difficulty 
with  learning  most  tasks  (26  of  29 
rated) . 


B.  Self-assessment  data  1.  Students  In  Program  B  predicted 

they  would  make  fewer  errors  on  all 
tasks. 

2.  Students  In  Program  B  also  felt 
they  had  made  fewer  errors  on  most 
tasks  (27  of  29  rated). 


Whether  training  Is  distributed  or  concentrated  does  appear  to  have  an  Impact 
on  Instructional  efficiency.  Students  In  the  longer  program  flew  fewer  flight 
hours,  particularly  dual  flight  hours,  than  did  those  In  the  shorter  program. 
Given  the  costs  (and  fuel  consumption)  associated  with  flight  hours,  espe¬ 
cially  dual  hours,  this  finding  Is  of  substantial  practical  Importance. 
Differences  between  programs  could  add  up  to  as  much  as  10  percent  of  total 
training  costs. 

The  Increased  efficiency  of  the  longer  program  Is  also  reflected  In  the  pat¬ 
terns  of  student  progress  through  flight  training.  When  differences  existed, 
students  In  the  longer  program  tended  to  perform  better  on  the  four  checkrldes 
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administered  periodically  during  training.  A  different  trend  appeared,  how¬ 
ever,  when  patterns  of  student  progress  through  ground  school  training  were 
assessed.  In  this  case,  students  In  the  shorter  program  did  better  on  the 
periodic  written  quizzes  given  during  ground  training.  Thus,  It  would  be 
beneficial  to  schedule  ground  and  flight  training  segments  at  different  rates 
to  take  advantage  of  positive  aspects  of  concentrated  and  distributed 
training. 

In  agreement  with  observed  differences  on  training  efficiency,  certain  pat¬ 
terns  appeared  In  the  way  students  perceived  their  training.  Students  In  the 
longer  program  felt  slightly  more  positive  toward  their  flight  training, 
although  they  preferred  to  have  flown  more  frequently.  Students  In  the 
shorter  program  felt  their  flight  training  was  more  harried  and  that  It 
distracted  them  more  from  their  job.  Additionally,  students  In  the  shorter 
program  appeared  to  be  less  confident  In  their  training  than  those  In  the 
longer  program. 

As  previously  discussed,  full  determination  of  the  Impact  of  different  distri¬ 
butions  of  training  time  will  be  made  In  the  second  phase  of  the  present 
study.  Indeed,  even  though  the  first  phase  Is  of  value  In  Itself,  It  Is 
during  the  second  phase  that  the  most  crucial  questions  concerning  the  effects 
of  training  and  experience  distribution  on  the  performance  of  certificated 
pilots  will  be  Investigated.  Do  differences  In  the  distribution  of  training 
time  affect  retention  of  flying  skills?  Do  differences  In  the  rates  of  flying 
after  certification  Influence  retention  of  these  skills,  and.  If  so,  which 
ones  are  affected  most  and  how  are  they  affected?  What  other  factors  Influ¬ 
ence  retention  of  flying  skill?  Determination  of  the  answers  to  these  ques¬ 
tions  will  aid  In  the  development  of  effective  and  efficient  pilot  training/ 
retraining  programs  and  of  procedures  for  their  associated  reviews  of  pilot 
proficiency.  In  short,  such  answers  will  aid  In  the  development  of  better 
means  for  managing  the  skill  maintenance  problems  of  general  aviation.  The 
effort  reported  here  provides  both  directly  usable  Information  In  tiiat  regard 
and  a  baseline  for  evaluating  results  of  the  second  phase  skill  retention 
study . 
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APPENDIX  A 

DISCUSSION  OF  PAST  RESEARCH 


A  considerable  amount  of  psychological  research  has  been  devoted  to  the  study 
of  (1)  the  Impact  of  different  distributions  of  training  time  on  the  acquisi¬ 
tion  of  complex  skills,  and  (2)  factors  Influencing  the  retention  of  such 
skills.  Since  comprehensive  reviews  of  this  research  are  available  (and  are 
referenced  below).  It  will  not  be  reviewed  here.  Rather,  the  following  sec¬ 
tions  discuss  the  Implications  of  the  results  of  this  research  for  the  design 
of  the  present  study  and  for  the  Interpretation  of  Its  findings. 

DISTRIBUTION  OF  TRAINING  TIME. 

Psychologists  Interested  In  human  learning  have  long  studied  the  Impact  of 
different  distributions  or  schedules  of  practice  on  the  acquisition  and  reten¬ 
tion  of  psychomotor  and  other  skills.  Determination  of  the  manner  In  which 
different  strategies  of  scheduling  practice  Influenced  learning  provided  data 
for  developing  fundamental  theoretical  constructs  concerning  how  humans  learn. 
As  such,  reviews  of  learning  research  and  theory  usually  contain  reviews  of 
numerous  studies  devoted  to  this  topic  (e.g.,  Bilodeau,  1969;  Deese  and  Hulse, 
1967;  Naylor  and  Briggs,  1961). 

In  addition  to  theoretical  implications,  research  on  the  Influence  of  practice 
on  skill  acquisition  has  also  been  motivated  by  applied  considerations. 
Behavioral  scientists  interested  In  developing  training  programs  for  a  variety 
of  jobs  and  athletic  skills,  for  example,  have  conducted  research  to  determine 
how  this  training  might  best  be  scheduled.  Thus,  Information  concerning  the 
influence  of  distributions  of  practice  can  also  be  found  in  the  applied 
research  literature  concerned  with  such  training  (e.g.,  Gagne  and  Bolles, 
1959,  pp.  26-48;  Howell  and  Goldstein,  1971;  lawther,  1977). 

It  Is  difficult,  however,  to  use  the  results  of  this  past  research,  applied  or 
basic,  to  develop  general  guidelines  for  scheduling  flight  training.  In  part, 
applicability  of  the  results  of  this  research  Is  limited  by  the  frequent  use 
of  simplistic  and,  at  times,  highly  artificial  tasks  In  these  past  studies. 
While  use  of  such  tasks  enables  a  substantial  amount  of  control  in  an  experi¬ 
ment,  It  also  reduces  the  general  1  zab  11  ity  of  study  resul ts—  given  a  lack  of 
theories  for  relating  such  tasks  to  more  complex  tasks  such  as  those  Involved 
In  flying.  Furthermore,  the  nature  of  experimental  conditions  studied  In  past 
efforts  Is  quite  restricted  vften  compared  with  conditions  Involved  In  flight 
training.  The  length  of  the  Interval  between  practice  sessions,  for  Instance, 
was  often  a  matter  of  minutes,  as  opposed  to  much  longer  intervals  character¬ 
istic  of  flight  training,  and  experimental  training  programs  were  almost 
always  far  less  extensive  and  disruptive  of  other  ongoing  activities  than  Is 
private  pilot  training. 

Nevertheless,  the  results  of  many  of  these  experiments  are  of  substantial 
value  in  Identifying  general  factors  Inherent  In  different  strategies  for 
scheduling  practice  that  serve  to  facilitate  or  hinder  learning.  Research  has 


shown,  for  example,  that  one  of  the  advantages  of  concentrated  practice,  rela¬ 
tive  to  more  distributed  practice,  Is  that  It  minimizes.  In  certain  situa¬ 
tions,  forgetting  between  learning  sessions.  Concentrated  practice  also 
usually  enables  the  learner  to  build  higher  skill  levels  over  a  shorter  calen¬ 
dar  time,  often  Increasing  the  learner's  motivation  to  devote  more  effort  to 
training.  On  the  other  hand,  concentrated  practice  on  some  tasks  leads  to 
fatigue  that  reduces  the  efficiency  of  learning.  It  can  also  reduce  the 
amount  of  time  a  student  has  to  prepare  for  a  training  session,  and  increase 
the  potential  for  conflict  between  preparatory  activities  and  other  activities 
outside  training  (e.g.,  job,  home  life). 

Additionally,  concentrated  training  also  can  reduce  the  amount  of  time  a  stu¬ 
dent  has  to  "sort  out"  various  aspects  of  skill  performance  so  that  similar 
components  will  not  be  confused  with  each  other.  To  the  extent  that  motor 
skills  must  be  coordinated  with  visual  cues,  judgments,  and  decisions  as  they 
are  during  flight,  the  likelihood  of  confusion  Is  Increased.  Generally,  for 
skills  of  a  given  complexity,  the  confusion  can  be  reduced  to  the  extent  that 
each  separate  skill  Is  mastered,  or  sufficient  time  elapses  between  practice 
sessions  for  the  confusion  to  dissipate. 

The  relative  advantages  of  concentrated  training  (e.g.,  less  chance  of  for¬ 
getting,  less  calendar  time  needed  to  achieve  higher  skill  levels)  and  of 
distributed  training  (e.g.,  less  possibility  of  fatigue,  more  time  for  pre¬ 
paration,  less  chance  of  confusion  across  training  sessions)  depend  to  a  large 
extent  on  the  types  of  tasks  which  are  learned.  For  example,  tasks  with  less 
internal  structure,  such  as  procedural  tasks,  tend  to  be  more  prone  to  being 
forgotten.  Thus,  distributed  practice  of  procedural  tasks  may  not  be  as  effi¬ 
cient  as  more  concentrated  practice  in  which  there  Is  less  chance  for  students 
to  forget  what  they  have  learned  in  earlier  sessions. 

These  general  findings  of  past  research  have  several  Implications  for  the  pre¬ 
sent  study.  The  existence  of  variation  in  the  Impact  of  distributed  training 
across  different  types  of  tasks,  for  example,  means  that  the  measures  used  In 
the  study  had  to  be  sensitive  to  possible  task  by  training  schedule  Interac¬ 
tions.  That  Is,  the  measures  had  to  be  able  to  discriminate  If  students  In 
the  shorter  flight  training  program  learned  some  tasks,  but  not  others,  more 
efficiently  than  students  In  the  longer  program  (and  vice  versa).  Global 
measures  of  overall  flight  performance  would  not  allow  such  differences  to  be 
detected. 

Additionally,  measures  were  needed  that  enabled  differences  in  patterns  of 
training  progress  In  the  two  programs  to  be  described.  Such  assessments  would 
provide  Information  to  aid  In  the  interpretation  of  why  the  performance  of 
students  In  the  program  differed.  Similarly,  measures  were  needed  that 
assessed  the  student's  attitudes  toward  the  training  they  received  and  Its 
Impact  on  their  life  (e.g.,  the  amount  It  distracted  from  their  normal  job). 
Such  measures  would  also  aid  In  understanding  any  performance  differences  that 
occurred  between  students  In  the  two  experimental  programs. 

RETENTION  OF  FLYING  SKILL. 

A  recent  study,  designed  to  Identify  major  human  factors  issues  In  general 
aviation,  concluded  that  the  loss  of  once  proficient  flying  skills  Is  one  of 
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the  most  critical  performance  problems  besetting  the  general  aviation  pilot 
community  (Shelnutt,  Childs,  Prophet,  and  Spears,  1980).  Indications  of  the 
current  seriousness  of  this  problem  can  be  obtained  from  the  review  of  general 
aviation  accidents  and  incidents.  While  deficiencies  within  the  data  des¬ 
cribing  these  accidents  and  Incidents  limit  their  use,1  several  In-depth 
reviews  of  certain  types  of  these  mishaps  have  concluded  that  improvements 
were  needed  In  recurrent  pilot  training  and  also  In  recurrent  reviews  of  pilot 
proficiency  to  prevent  future  accidents  attributable  to  skill  retention 
problems  (e.g.,  Munley,  1976;  National  Aeronautics  and  Space  Administration, 
1978;  National  Transportation  Safety  Board,  1972;  1974;  1976;  1979). 

Additional  indications  of  the  retention  problem  can  be  found  In  two  studies 
that  have  Investigated  the  loss  of  flying  skills  by  private  pilots  in  the 
years  after  their  certification  (Hollister,  LaPointe,  Oman,  and  Tole,  1973; 
Seltzer,  1970).  Although  confounded  by  certain  methodological  limitations 
(which  will  be  discussed  later),  both  of  these  studies  found  serious  deficien¬ 
cies  in  certain  types  of  flying  skills.  In  both  cases,  these  deficiencies 
were  related,  to  a  moderate  degree,  to  the  number  of  years  since  the  pilot  had 
been  certificated.  That  Is,  certain  flying  skills  tended  to  decline  as  the 
number  of  years  since  certification  increased. 

Thus,  In  a  sense,  the  goal  of  the  present  study  Is  to  aid  In  the  solution  of 

the  current  skill  retention  problem  as  well  as  to  prevent  it  from  becoming 

worse  as  private  pilots  fly  less.  To  accomplish  this  goal.  It  will  be 

necessary  to  produce  systematic  guidance  that  will  aid  In  the  Identification 
of  (1)  skills  most  likely  to  degrade  over  time,  and  (2)  factors  affecting  the 
way  In  which  they  degrade.  Such  guidance  will  enable  private  pilots  to  anti¬ 
cipate  their  recurrent  training  needs.  In  will  also  enable  them  (and  their 
Instructors)  to  structure  reviews  of  their  proficiency  (e.g.,  the  Biennial 
Flight  Review)  so  that  these  reviews  focus  on  skills  most  likely  to  have 

degraded. 

While  such  guidance  Is  not  presently  available,  considerable  information  can 
be  obtained  from  past  human  factors  and  basic  psychological  research  con¬ 
cerning  requirements  for  this  guidance,  and  how  the  guidance  can  be  developed. 
The  study  of  retention  or,  conversely,  the  forgetting  of  skills,  has  long  been 
a  subject  of  research,  dating  back  to  the  turn  of  this  century.  Much  of  the 
early  research  was  concerned  with  verbal  behavior  and  simple  motor  behavior 
(Naylor  and  Briggs,  1961).  While  the  results  of  this  research  are  not  of 
direct  relevance  to  the  present  study,  these  studies  provide  the  basic  theore¬ 
tical  foundation  for  modern  work  which  has  dealt  with  more  complex  skills. 

Many  of  these  more  recent  studies  represent  attempts  by  the  military  and  the 
National  Aeronautics  and  Space  Administration  to  develop  empirical  data  bases 
and  analytical  models  that  could  be  employed  In  the  development  of  recurrent 
training  programs  for  pilots  and  astronauts.  As  such,  much  of  this  work'ls 
relevant  to  goals  of  the  present  project.  Several  reviews  of  this  research 
are  available.  Prophet  (1976),  for  example,  has  reviewed  research  specif¬ 
ically  concerned  with  flying  skill  retention,  while  Schendel ,  Shields,  and 
Katz  (1978)  reviewed  research  concerned  with  more  general  Issues  of  skill 


*As  described  In  Shelnutt,  Childs,  Prophet,  and  Spears  (1980). 
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retention.  Additionally,  Eddowes  et  al .  (1981)  reviewed  a  recent  large  scale 
flying  skill  retention  study,  the  Skills  Maintenance  and  Reacquisition 
Training  Research  Program,  which  was  conducted  to  support  the  development  of 
Improved  continuation  training  programs  In  the  U.S.  Air  Force.  These  reviews 
and  others  (e.g.,  Gardlln  and  Sltterley,  1972;  Wright,  1969)  have  covered  the 
Issues  well,  so  past  research  on  flying  skill  retention  will  not  be  reviewed 
here.  Rather,  selected  major  findings  of  this  research,  which  directly 
influenced  the  planning  of  the  present  study,  are  summarized  below. 

Perhaps  the  most  consistent  finding  of  previous  studies  of  forgetting  is  that 
the  retention  of  a  skill  is  a  negatively  accelerated  function  of  the  length  of 
time  since  the  skill  was  last  performed.  That  is,  the  longer  the  time  without 
practice  of  skill,  the  greater  the  degradation  of  the  skill.  Unfortunately, 
the  specific  pattern  of  forgetting  In  a  given  situation  Is  a  function  of  a 
number  of  different  factors.  Thus,  in  order  to  be  able  to  predict  when  a 
skill  will  degenerate  to  unacceptable  levels,  it  is  necessary  to  Identify  the 
factors  operating  In  the  situation  being  investigated  and  to  determine  their 
specific  Impact  on  skill  loss.  Several  general  categories  of  such  factors 
have  been  identified  in  past  research.  Those  of  interest  with  respect  to  the 
objectives  of  the  present  study  concern  (1)  the  nature  of  the  original 
learning — i.e.,  how  well  a  task  was  learned  and  the  conditions  under  which 
learning  occurred;  and  (2)  the  characteristics  of  the  tasks  being  performed. 

DIFFERENCES  IN  ORIGINAL  TRAINING.  The  most  significant  factor  Influencing  the 
retention  of  flight  skills  is  the  level  to  which  they  are  learned  originally 
(Prophet,  1976).  Simply  put,  the  greater  the  mastery  during  original 
training— or  at  any  time  prior  to  periods  of  non- practice- -the  higher  perfor¬ 
mance  will  be  after  periods  of  non-practice.  The  dominance  of  mastery  has  two 
major  implications  for  the  methodology  of  the  present  study.  First,  when 
possible,  studies  of  flight  skill  retention  should  Include  assessments  of  the 
original  level  of  skill  attained  by  pilots  during  their  initial  training  for 
certification.  Thus,  subsequent  measures  of  their  performance  can  be  compared 
directly  with  their  original  level  of  learning. 

Studies  which  permit  such  comparisons,  referred  to  by  psychologists  as 
"longitudinal"  studies,  have  several  advantages  when  compared  to  so-called 
"vertical"  or  cross-sectional  studies  in  which  the  performance  of  a  group  of 
pilots  with  different  lengths  of  time  since  certification  Is  measured.  In  the 
vertical  study,  for  example,  differences  In  performance  between  pilots  are 
attributed  In  part  to  differences  In  retention  of  skills.  The  assessment  of 
these  differences  are  confounded,  however,  by  unknown  variation  In  performance 
due  to  Individual  differences  In  the  original  level  of  learning.  Given  these 
differences,  It  Is  Impossible  to  quantify  the  exact  relationship  among  any 
factors  of  Interest— e.g,  task  characteristics,  or  the  amount  of  flying  since 
certification— and  actual  retention  of  skills  to  perform  different  tasks. 

Such  confounding  has  reduced  the  value  of  the  only  two  previous  studies  of 
private  pilot  flying  skill  retention  (Hollister  et  al.,  1973;  Seltzer,  1970). 
While  both  of  these  studies  provided  evidence  that  skill  retention  Is  a 
problem  for  many  private  pilots,  the  Interpretation  of  their  results  Is 
limited  by  the  lack  of  measurement  of  the  original  level  of  learning.  In  both 
studies,  for  example,  the  extent  of  the  skill  retention  problem  In  general 
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aviation  was  revealed  by  the  fact  that  the  majority  of  the  private  pilots  who 
participated  In  the  studies  were  judged  to  be  deficient  with  respect  to  at 
least  some  of  the  tasks  that  were  tested.  The  extent  of  their  deficiencies 
was  correlated  to  some  degree  with  the  amount  of  flying  they  had  done  since 
certification  and  the  recency  with  which  they  had  flown  relative  to  their 
testing  during  the  research.  Interpretation  of  these  correlations  is  made 
uncertain,  however,  by  the  lack  of  information  concerning  original  level  of 
learning. 

The  second  consideration  Implied  by  the  dominance  of  original  level  of 
learning  as  a  skill  retention  factor  relates  to  the  importance  of  initial 
training  for  retention.  Since  how  well  an  individual  learns  a  task  largely 
determines  how  well  he  will  retain  it,  factors  influencing  the  effectiveness 
of  initial  training  also  affect  skill  retention.  Furthermore,  how  a  skill  is 
learned  may  also  affect  how  well  it  is  maintained.  Certain  instructional 
practices  may,  for  example,  foster  retention  of  skills  better  than  other 
approaches,  even  though  they  may  both  result  in  the  same  apparent  level  of 
learning  originally.  Thus,  the  conditions  for  learning,  as  well  as  how  well  a 
pilot  initially  learns  a  skill,  may  be  important  in  retention. 

TASK  CHARACTERISTICS.  The  retention  of  different  flight  tasks  also  varies 
with  respect  to  the  characteristics  of  the  tasks.  For  example,  tasks  with  a 
high  degree  of  Internal  organization,  such  as  flight  control  tasks,  tend  to  be 
better  retained  than  those  with  less  internal  organization,  such  as  many  pro¬ 
cedural  tasks  (Prophet,  1976).  Thus,  performance  of  Instrument  procedures 
tasks  tends  to  degrade  faster  than  that  of  contact  tasks  (Sltterley,  Zaltzeff, 
and  Berge,  1972;  Wright,  1973). 

The  existence  of  differences  In  the  retention  of  various  tasks  has  two  major 
Implications  for  the  present  study.  First,  the  differences  require  that  pilot 
performance  be  measured  on  Individual  tasks  that  are  of  Interest.  As  such, 
global  measures  of  flying  proficiency  are  of  little  value— e.g.,  a  single 
general  rating  of  pilot  proficiency  or  use  of  only  a  small  number  of  dimen¬ 
sions.  Moreover,  given  practical  constraints,  all  tasks  performed  by  private 
pilots  cannot  be  measured.  Thus,  care  must  be  taken  to  select  a  represen¬ 
tative  sample  of  tasks.  Second,  to  aid  in  the  Interpretation  of  the  results 
of  research  on  skill  loss,  data  describing  errors  In  task  performance  need  to 
be  of  sufficient  detail  to  enable  understanding  of  vrfiy  the  errors  occurred. 
Such  understanding  Is  necessary  to  the  determination  of  triiy  the  skill  of  a 
pilot  to  perform  certain  tasks  degrades  In  the  manner  It  does. 

In  summary,  a  considerable  amount  of  research  has  been  devoted  to  the  study  of 
(1)  the  Influence  of  different  distributions  of  training  time  on  Instructional 
effectiveness  and  efficiency,  and  (2)  the  Impact  of  different  factors  on  the 
retention  of  complex  skills.  While  such  research  does  not  provide  direct 
guidance  concerning  the  problems  addressed  In  the  present  study,  they  do  pro¬ 
vide  considerable  Information  which  can  guide  both  the  design  of  a  study  and 
the  Interpretation  of  Its  results. 
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APPENDIX  B 

GROUND  AND  FLIGHT  TRAINING  SYLLABI 


GROUND  SCHOOL  TRAINING  SYLLABUS 


LESSON  1 


TOPIC: 

Course  Introduction 
Aircraft  Types 
Aircraft  Construction 
Theory  of  Lift 
Force  Relationships 
Three  Axes 

Flight  Dynamics— Rel ation  of 

Four  Forces  to  Four  Basic  Flight  Maneuvers 
Aircraft  Stability 
Engine  -  Propeller  Turning  Effects 

PERFORMANCE  OBJECTIVES: 

Name  and  locate  major  components 

Compare  aircraft  types 

Define  angle  of  attack  and  stall 

Describe  theory  of  lift 

List  the  four  forces 

Relate  controls  to  aircraft  movement 

Describe  four  basic  flight  maneuvers 

Define  stability 

Describe  turning  forces 


LESSON  2 


TOPIC: 

Quiz  1:  Aerodynamics 

Flight  Control  Systems  and  Flight  Instruments:  Mag.  Compass,  Outside  Air 
Temperature 

Pitot-Static  System  and  Gyroscopic  Instruments 

Engine  Operation;  Oil  System;  Fuel  System;  Electrical  System 

Airport  Operations 

PERFORMANCE  OBJECTIVES: 

Describe  fl  Ight  control  systems 
Account  for  magnetic  compass  errors 
Define  standard  atmosphere 
Define  five  types  of  altitude 
Define  three  types  of  airspeed 
Describe  Airspeed  Indicator  color  code 
Describe  gyroscopic  Instruments 
State  engine  operating  principles 
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LESSON  2  (Continued) 


Compare  two  basic  fuel  systems 
State  function  and  location  of  electrical  components 
Interpret  standard  airport  marking  and  lighting  symbology 
Describe  traffic  pattern 


LESSON  3 


TOPIC: 

Operating  Near  Other  Aircraft 

Airport  Air  Traffic  Control 

Airport  Communications 

Aircraft  Stability  and  Control 

Determining  Gross  Weight  and  C.G.  Location 

Weight  and  Balance  Computations 

Basic  Laws  Relating  to  Aircraft  Performance 

PERFORMANCE  OBJECTIVES: 

Describe  vortex  turbulence  characteristics  and  avoidance  procedures 
Describe  basic  ATC  services  at  airport 
Define  load  factor 

Relate  loading  condition  to  stability  and  performance 
Determine  loaded  aircraft  gross  weight  and  C.G.  location 
List  standard  values  for  passenger,  fuel,  and  oil  weights 
Determine  loading  condition  using  graphic  and  tabular  methods 
Describe  density  altitude  concept 
Compute  pressure  altitude  and  density  altitude 
Describe  factors  affecting  general  aircraft  performance 


LESSON  4 


TOPIC: 

Takeoff  Performance 

Climb  Performance 

Cruise  Performance 

Landing  Performance 

Characteristics  of  Atmosphere 

General  Circulation 

Air  Masses 

Condensation 

Precipitation 

Stability  and  Cloud  Types 

Quiz  2:  Airport  Operations,  Weight  and  Balance 
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LESSON  4  (Continued) 


PERFORMANCE  OBJECTIVES; 

Compute  takeoff  performance 

Define,  compare,  and  compute  best  rate  of  climb  and  best  angle  of  climb 
airspeeds 

Describe  factors  affecting  takeoff  and  climb  performance 
Compute  various  cruise  performance  characteristics 
Describe  techniques  of  maximizing  range  and  endurance  performance 
Compute  landing  performance 

Describe  factors  affecting  cruise  and  landing  performance 
Demonstrate  ability  to  calculate  performance  limitations  and  understand 
factors  affecting  performance 
Describe  three-cell  circulation  model 
Describe  global  circulation  model 

Classify  clouds  and  Identify  associated  weather.  If  any 
State  relationship  between  moisture,  temperature,  and  stability 
Define  a  temperature  inversion  and  state  its  significance 


LESSON  5 


TOPIC: 

Pressure  Systems 

Fronts  and  Associated  Weather 

Weather  Hazards 

Weather  Reports  and  Forecasts 

Quiz  3:  Aircraft  Performance 

PERFORMANCE  OBJECTIVES: 

Locate  source  regions  and  list  characteristics  of  their  associated  air  masses 

Relate  wind  and  pressure 

List  and  define  2  types  of  pressure  systems 

Define  pressure  gradient 

Describe  the  various  fog  formation  processes 

List  factors  necessary  for  thunderstorm  development 

Define  mountain  wave 

Compare  rime  and  clear  Ice 

Read  and  Interpret  aviation  hourly  weather  reports 

Read  and  interpret  terminal  forecasts 

Read  and  Interpret  area  forecasts 

Read  and  Interpret  winds  aloft  forecasts 

Compare  and  read  SIGMETS,  AIRMETS,  and  PIREPS 
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LESSON  6 


TOPIC: 

Weather  Charts 

Obtaining  and  Coordinating  Weather  Information 
Weather  Avoidance  Procedures 
Reporting  Weather  In  Flight 

PERFORMANCE  OBJECTIVES: 

Decipher  state  model 

Interpret  all  Information  on  the  surface  analysis  chart 
Interpret  Information  on  the  weather  depiction  chart 
State  frequency  and  describe  purpose  of  EWAS 

Compare  and  describe  transcribed  weather  broadcasts,  scheduled  and  unscheduled 
broadcasts 

Describe  procedure  for  obtaining  In-flight  weather  advisories 
Define  CAT  (Clear  Air  Turbulence) 

Describe  procedure  for  avoiding  thunderstorms 
Define  four  classifications  of  Ice  accumulation 


LESSON  7 


TOPIC: 

Definitions  and  Abbreviations  in  FARS 

Pilot  Certification  Procedures 

Airspace  Utilization 

Quiz  4:  Aviation  Weather 

PERFORMANCE  OBJECTIVES: 

Compare  category,  class,  and  type  as  each  relates  to  aircraft  and  airmen 
certi  fl  cation 

Define  controlled  airspace,  night  time,  flight  time,  ceiling,  and  airport 
traffic  area 

List  eligibility  requirements  for  student  and  private  pilots 

State  expiration  date  of  each  medical  certificate 

State  limitations  of  private  pilot  certificate 

Define  PCA,  CCA,  controlled  areas,  transition  area,  control  zones,  airport 
traffic  area,  and  AAAs 


LESSON  8 


TOPIC: 

Operating  Rules  and  Regulations— General 
Operating  Rules  and  Regul atlons— Fl ight  Rules 
Aircraft  Maintenance 


LESSON  8  (Continued) 


Accident-Reporting  Procedures 

Overview  of  Navigation  Methods:  Pilotage,  Dead  Reckoning,  and  Radio 
Navigation 

PERFORMANCE  OBJECTIVES: 

Demonstrate  ability  to  apply  regulations  to  specific  flight  situations 
State  date  for  annual  Inspection 

State  requirements  for  100  hour  Inspection,  Include  time  requirements  and 
1  Imitations 

Name  person  responsible  for  maintenance  records  and  list  of  records 
Define  operator,  serious  Injury,  and  substantial  damage 
State  when  report  must  be  made 

State  when  Immediate  notification  of  accident  must  be  made  and  to  whom 
Define  three  approaches  to  navigation 


LESSON  9 


TOPIC: 

Navigation  Computer:  Slide  Rule  Side 
Navigation  Computer:  Wind  Side 

PERFORMANCE  OBJECTIVES: 

Locate  and  name  each  of  the  scales  on  the  slide  rule  side  of  the  computer 
Solve  for  time,  speed,  and  distance  when  any  of  the  other  2  are  provided 
Solve  for  amount  of  fuel,  rate  of  consumption,  or  endurance  when  any  of  the 
other  two  are  provided 
Compute  true  altitude 
Compute  true  airspeed 
Compute  density  altitude 
Use  all  conversion  scales 

Solve  for  heading  correction  to  parallel  or  return  to  desired  track  when 
blown  off  course 

Perform  complex  navigation  problems 
Compute  time  and  distance  to  station 
Construct  the  wind  triangle 
Define  wind  correction  angle 


LESSON  10 


TOPIC: 

Navigation  Computer:  Wind  Side 
Aeronautical  Charts 
Chart  Orientation 
Aeronautical  Chart  Interpretation 
Navigational  Plotter 
Quiz  5:  FAR’s 
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LESSON  10  (Continued) 
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PERFORMANCE  OBJECTIVES: 

Name  and  locate  the  components  of  the  wind  side  of  the  navigation  computer 
Use  the  computer  to  solve  wind  triangles- -both  prefllght  and  Inflight 
Demonstrate  ability  to  use  computer  to  perform  all  required  computations 
Compare  various  aeronautical  charts 

Compare  Mercator  with  Lambert  Conformal  chart  projections 
Specify  directions  In  relation  to  compass  rose 
Define  latitude  and  longitude 

Locate  position  on  chart  with  geographic  coordinates 
Define  magnetic  variation  and  use  of  Isogonlc  lines  to  determine  its  value 
Compare  and  Indicate  specific  advantage  or  use  of  various  aeronautical  charts 
Interpret  symbols  on  all  charts  (Sectional  and  WAC) 

Use  navigation  plotter  to  measure  distance  between  and  direction  between  any 
two  places  on  the  sectional  chart 


LESSON  11 


TOPIC: 

Dead  Reckoning 
FI Ight  Log  Prep 
Flight  Log  Usage 
Overview  of  VOR  Navigation 
Introduction  to  VOR 
VOR  Navigation 

PERFORMANCE  OBJECTIVES: 

Use  computer,  plotter,  and  chart  to  determine  compass  heading  and  elapsed 
time  estimates 

Complete  flight  log  for  given  cross-country  flight 

Demonstrate  ability  to  use  D.R.  navigation  technique 

Describe  principles  of  and  operation  and  limitations  of  VOR  navigation 

Define  VOR,  TACAN,  DME,  and  VORTAC 

Describe  sectional  chart  symbology  for  each 

Describe  VOR  receiver  components  j  ..  , 

Locate  position  of  aircraft  in  relation  to  station  using  VOR  display 


LESSON  12 


TOPIC: 

VOR  Navigation 

DME  and  Area  Navigation 

A OF  Navigation 

Radio  Navigation  Practice  Problems 


LESSON  12  (Continued) 


PERFORMANCE  OBJECTIVES: 

Use  VOR  to  Intercept  and  track  radial s 
Explain  cross-check  procedure  and  VOR  usage 

Describe  principle  of  operation  and  limitations  and  usage  of  DME  and  Area 
Navigation  systems 

Describe  principles  of  operation  and  limitations  and  usage  of  ADF  systems 
Apply  various  radio  navigational  techniques  to  cross-country  problems 


LESSON  13 


TOPIC: 

Flight  Communications 
ATC  Procedures 

PERFORMANCE  OBJECTIVES : 

Demonstrate  ability  to  use  all  appropriate  radio  aids  in  solving  navigational 
problems 

Determine  FSS  communications  frequency  from  sectional  charts  data  block 

State  the  important  FSS  frequencies  and  their  use 

Define  unicorn  and  state  its  purpose  and  compare  with  multicom 

State  standard  Emergency  Frequency  and  state  procedures  for  using  it 

Compare  ASR  with  PAR  radar 

State  use  of  ATCRBS 

List  six  advantages  of  secondary  radar 
Name  and  locate  the  typical  components  of  the  transponder 
Define  phraseology  unique  to  transponder  operation 
List  and  state  use  of  discrete  transponder  codes 
Describe  various  radar  services 


LESSON  14 


TOPIC: 

Publications:  The  Airmans  Information  Manual 
The  Advisory  Circular  System 

Aeromedlcal  Topics,  Respiratory  System  Limitations  and  Dysfunction 
Sensory  Limitations 
Effects  of  Drugs  and  Alcohol 
Quiz  6:  Radio  Navigation 

PERFORMANCE  OBJECTIVES: 

Name  the  basic  parts  plus  the  supplement  to  the  AIM;  state  use  of  each,  and 
frequency  of  Issue 

Decipher  airport  directory  and  facility  information 


LESSON  14  (Continued) 

Locate  and  Interpret  Notam  Information 

Use  AIM  as  reference  to  answer  appropriate  questions 

D1scussecauserof°hypox1a^r^1strsymptoms  and  methods  of  prevention 
Discuss  hyperventilation:  list  causes,  symptoms  and  recovery  techniques 
Describe  various  sources  of  sensory  confusion  and  degradation 
Discuss  likely  effects  of  drug  and  alcohol  consumption 


LESSON  15 


TOPIC: 


Comprehensive  Flight  Planning  and  Execution 

Course  Review 
Final  Exam 

PERFORMANCE  OBJECTIVES: 

Prepare  comprehensive  planning  for  hypothetical  VFR  cross-country  flight, 

using  all  material  previously  discussed  in  body  of  course 
Rp^olve  anv  unanswered  Question  and  prepare  for  final  exam 
Demonstrate  ability  to 'apply  skill  .knowledge  acquired,  and  skills  developed 

during  this  course 
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PRIV/TE  PILOT  FLIGHT  TRAINING  SYLLABUS 


PREREQUISITES  FOR  ENROLLMENT. 

The  student  must  possess  a  valid  Student  Pilot's  Certificate  and  hold  at  least 
a  Class  III  medical  certificate. 


FLIGHT  TRAINING  COURSE  OBJECTIVES. 

The  student  will  obtain  the  necessary  aeronautical  skill  and  experience  toward 
meeting  the  requirements  for  a  Private  Pilot  Certificate  with  an  airplane 
category  rating,  and  a  single  engine  land  class  rating. 

FLIGHT  TRAINING  COURSE  COMPLETION  STANDARD. 

The  student  has  demonstrated  through  flight  tests  and  records  that  he/ she  has 
the  necessary  aeronautical  skill  and  experience  to  successfully  complete  all 
requirements  for  a  Private  Pilot  License. 


PHASE  I  -  PRESOLO 


OBJECTIVE 


The  student  will  be  Instructed  In  the  basic  flying  procedures  and  skills 
necessary  for  the  first  solo  flight. 

STANDARDS 


This  phase  will  be  complete  when  the  student  satisfactorily  passes  the  Phase  I 
check  and  is  able  to  conduct  solo  flights  safely. 

LESSON  1  -  ORIENTATION 

Objective:  To  familiarize  the  student  with  the  course  objectives, 

training  facilities,  student/instructor  relationship,  required  course 
materials,  training  schedule  procedures  and  record  keeping  procedures. 

Standards:  At  the  completion  of  this  lesson,  the  student  should 
understand  tRe  course  objectives,  training  schedule  procedures  and  record 
keeping  procedures.  The  student  should  also  have  In  his/her  possession  all 
required  course  materials  and  know  what  training  facilities  are  available  and 
the  location  of  those  training  facilities. 

LESSON  2  -  PREFLIGHT  AND  GROUND  OPERATIONS 

Objective:  The  student  will  be  introduced  to  the  appropriate  regulatory 
requirements  of  FAR  Part  1-61-91.  He/ she  will  also  be  Introduced  to  the 
proper  procedures  to  conduct  a  preflight  inspection  of  the  training  aircraft 
and  the  proper  ground  safety  precautions. 

Standards:  At  the  conclusion  of  this  lesson  the  student  should  be  able 
to  use  tRe  fAR's  to  determine  appropriate  Information,  have  a  working 
knowledge  of  the  various  parts  of  the  aircraft  for  preflight  purposes,  and  a 
thorough  knowledge  of  the  ground  safety  requirements. 

LESSON  3  -  AIRCRAFT  FAMILIARIZATION 

Objective:  The  student  will  become  familiar  with  the  training  aircraft 
both  by  observing  an  actual  flight  and  by  receiving  his/her  first  flight 
instruction  In  an  airplane.  The  student  win  both  observe  and  receive 
Instruction  In  the  basic  flying  maneuvers. 

Standards:  At  the  conclusion  of  this  lesson,  the  student  should  be  able, 
with  assistance,  to  determine  the  aircraft  to  be  In  airworthy  condition  by  a 
proper  preflight  inspection,  properly  startup  and  shutdown  the  aircraft,  make 
engine  run-ups,  follow  proper  radio  procedures,  maintain  altitude  with  ±  200 
feet,  heading  within  +  20  degrees  and  recognize  proper  aircraft  flight  atti¬ 
tudes.  He/ she  should  also  follow  established  ground  and  airport  safety 
procedures. 
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LESSON  4  -  SLOW  FLIGHT  AND  STALLS 


Objective:  The  student  will  receive  instruction  in  controllino  the 

aircraft  at  both  reduced  airspeeds  and  minimum  airspeeds,  with  and  without 
flaps.  The  student  will  also  receive  instruction  In  the  recognition  and 
proper  recovery  from  both  imminent  and  full  stalls  that  may  occur  from  nor¬ 
mally  anticipated  flight  attitudes. 

Standards:  At  the  conclusion  of  this  lesson,  the  student  should  He  able 
to  properly  control  the  aircraft  with  reduced  airspeeds,  from  cruise  down  to 
minimum  speed  both  with  and  without  flaps.  He/ she  will  also  be  required  to 
properly  initiate,  recognize,  and  recover  from  imminent  and  full  stalls;  main¬ 
tain  altitude  within  +.  150  feet,  heading  within  ±.  20  degrees,  airspeed  within 
_  10  mph.  Recovery  from  stalls  should  be  made  with  little  or  no  loss  of 
control  and  a  minimum  loss  of  altitude. 

LESSON  5  -  GROUND  REFERENCE  MANEUVERS 


Objectives:  To  teach  the  student  to  maneuver  the  aircraft  over  or  around 
a  predetermined  ground  path  at  an  approximate  traffic  pattern  altitude.  The 
student  will  be  taught  to  properly  compensate  for  wind  drift  while  oividing 
his  attention  Inside  and  outside  the  aircraft. 

Standards:  At  the  conclusion  of  this  lesson,  the  student  should  be  able 
to  properly  select  ground  references  and  maneuver  the  aircraft  in  relation  to 
these  references.  The  student  should  accomplish  these  maneuvers  with  coordi¬ 
nated  turns,  smooth  control  pressures,  and  proper  division  of  attention  while 
maintaining  altitude  within  .1  100  feet  and  airspeed  within  i  10  mph. 

LESSON  6  -  TRAFFIC  PATTERN  OPERATIONS 

Objective:  To  ensure  the  student  has  a  thorough  understanding  of  airport 
traffic  patterns  and  procedures  at  both  controlled  and  uncontrolled  airports. 
To  teach  the  student  proper  airport  entry  and  departure  procedures  as  well  as 
proper  communications  procedures.  The  student  will  be  taught  to  accomplish 
takeoffs  and  landings  under  all  normally  anticipated  conditions,  to  Include 
traffic  pattern  emergencies. 

Standards :  At  the  conclusion  of  this  lesson,  the  student  will  be 
expected  to  safely  takeoff  and  land  the  aircraft,  unassisted,  under  all  nor¬ 
mally  anticipated  conditions.  He/she  will  be  expected  to  accomplish  this 
while  observing  proper  traffic  pattern  procedures,  collision  avoidance  proce¬ 
dures,  and  communication  procedures  and  to  respond  properly  to  emergency 
situations. 

LESSON  7  -  BASIC  AIRWORK  AND  TRAFFIC  PATTERN  REVIEW 


Objectives:  This  lesson  will  be  used  as  a  comprehensive  review  of  the 
subject  matter  covered  previously.  Emphasis  will  be  placed  on  the  individual 
student's  weak  areas  in  preparation  for  the  Presolo  Phase  Check. 


LESSON  7  (Continued) 

Standards:  At  the  completion  of  this  lesson,  the  student  must  display  a 
thorough  understanding  of  all  previously  learned  procedures  and  have  attained 
the  required  level  of  safety  and  competence  to  perform  each  maneuver  with  no 
assistance  from  the  Instructor. 

LESSON  8  -  PRE-SOLO  PHASE  CHECK 


Objective:  To  determine  by  an  oral  exam  and  a  flight  check  that  the  stu¬ 
dent  has  the  necessary  knowledge  and  competence  to  safely  solo  an  airplane  and 
progress  to  the  next  phase  of  training  in  this  curriculum. 

Standards:  The  student  must  demonstrate  his/her  knowledge  and  competence 
to  safely  -solo  the  airplane  by  maintaining  altitude  within  ±  100  feet,  head¬ 
ing  within  ^  10  degrees,  airspeed  within  +,  10  mph,  maintain  coordinated 
control  of  the  aircraft,  and  demonstrate  proper  execution  of  any  Phase  I 
maneuvers  or  procedures  checked. 

LESSON  9  -  SUPERVISED  SOLO 


Objective:  During  this  lesson,  the  student  will  accomplish  his/her  first 
supervised  solo  flight  If  they  have  successfully  passed  the  Phase  I  check  and 
displayed  the  required  level  of  safety  and  skill. 

Standards:  The  student  must  display  his/her  continued  ability  to  suc- 
cessfully  perform  safe  and  competent  solo  flight. 


PHASE  II  -  BASIC  PILOT  OPERATIONS 


OBJECTIVE 


The  student  will  receive  additional  Instruction  In  the  basic  flying  maneuvers, 
receive  an  area  checkout,  be  Introduced  to  basic  attitude  Instrument  flying, 
VOR  work,  and  maximum  performance  takeoffs,  landings,  and  maneuvers.  He/she 
will  also  receive  directed  solo  practice  of  those  maneuvers. 

STANDARDS 


This  phase  will  be  complete  trtien  the  student  has  demonstrated  to  his/her 
flight  instructor  that  they  have  a  thorough  understanding  of  the  basic  flight 
maneuvers,  and  has  the  knowledge  and  skill  to  safely  practice  those  maneuvers 
and  progress  to  the  next  phase  of  training  in  this  course. 

LESSON  10  -  BASIC  FLYING  AND  AREA  CHECKOUT 


Objective:  To  provide  the  student  with  the  knowledge  and  understanding 
of  the  basic  flying  maneuvers  and  local  area  orientation  so  that  he/ she  can 
safely  practice  those  maneuvers  within  the  designated  practice  areas. 

Standards:  The  student  must  display  the  proficiency  and  competence 

required  to  make  repeated  solo  flights,  for  the  purpose  of  practicing  the 
required  maneuvers,  within  the  designated  practice  areas. 
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LESSON  11  -  BASIC  ATTITUDE  INSTRUMENT  AND  VOR  ORIENTATION 

Objective:  The  student  will  be  shown  the  correlation  between  flying  the 
aircraft  by  visual  references  and  by  flying  the  aircraft  with  Instrument 
references  and  indications.  He/ she  will  also  be  introduced  to  VOR  work;  to 
include  VOR  orientation  and  tracking  procedures. 

Standards:  At  the  completion  of  this  lesson,  the  student  should  have  a 
basic  "understanding  of  controlling  the  aircraft  by  use  of  the  flight  instru¬ 
ments  to  achieve  basic  aircraft  attitudes  and  maneuvers.  He/she  should  also 
be  able  to  orient  themselves  to  a  VOR  station  and  to  fly  to  that  station. 

LESSON  12  -  MAXIMUM  PERFORMANCE  TAKEOFFS  AND  LANDINGS 

Objective:  To  instruct  the  student  In  the  techniques  used  to  achieve  the 
maximum  performance  of  the  aircraft  in  taking  off  and  landing  In  short  or  soft 
field  conditions.  The  student  will  also  be  instructed  in  obtaining  this  per¬ 
formance  data  from  the  aircraft  manual. 

Standards :  This  lesson  will  be  complete  when  the  student  can  use  the 
available  information  to  determine  aircraft  performance  and  can  perform  the 
required  takeoffs  and  landings  under  all  normally  anticipated  conditions. 

LESSON  13  -  NIGHT  OPERATIONS 

Objective:  During  the  lesson,  the  student's  ability  should  be  developed 
to  a  level  that  would  enable  him/her  to  make  solo  night  flights  within  the 
local  practice  area  and  airport  traffic  area.  The  student  will  receive 
instruction  in  such  areas  as:  night  vision,  night  orientation,  judgment  of 
distance,  use  of  cockpit,  navigation,  landing  lights,  and  emergency  night  pro¬ 
cedures.  The  airport  and  runway  lighting  system  will  al so  be  discussed. 

Standards:  The  student  will  have  successfully  completed  this  lesson  vrfien 
he/ she  displays  the  ability  to  maintain  orientation  In  the  local  flying  area 
and  traffic  pattern,  can  accurately  interpret  aircraft  and  runway  lights,  and 
has  satisfactorily  made  5  takeoffs  and  landings  as  the  sole  manipulator  of  Ifie 
flight  controls.  “ 

LESSON  14  -  PROFICIENCY  REVIEW 

Objective:  The  student  will  receive  additional  Instruction  In  those 

maneuvers  or  procedures  In  which  he/ she  has  shown  a  weakness  or  lack  of 
understanding. 

Standards:  At  the  completion  of  this  lesson,  the  student  must  have 

achieved  a  level  of  skill  that  will  allow  him/her  to  progress  to  the  next 
phase  of  training. 


PHASE  III  -  CROSS-COUNTRY  FLIGHT  OPERATIONS 


OBJECTIVE 


The  student  will  be  Instructed  In  the  conduct  of  cross-country  flights  In  an 
airplane  using:  pilotage,  dead  reckoning,  and  radio  navigation.  He/she  will 
also  receive  Instruction  In  operations  within  the  ATC  environment  under  VFR 
conditions. 

STANDARDS 


This  phase  will  be  complete  vrfien  the  student  has  demonstrated  through  a  phase 
check,  solo  cross-country  flight,  and  records  that  he/she  can  safely  conduct 
solo  cross-country  flight  in  an  airplane  using  pilotage,  dead  reckoning,  and 
radio  navigation  under  VFR  conditions. 

LESSON  15  -  PRE-SOLO  CROSS-COUNTRY 


Objective:  During  this  lesson,  the  student  will  be  taught  to  navigate 
using  pilotage,  dead  reckoning,  and  radio  navigation.  He/ she  will  be  taught  to 
compute  fuel  consumption  and  ETA's  to  checkpoints  and  destinations;  properly 
file,  comply  with,  and  close  VFR  flight  plans;  properly  communicate  with  the 
appropriate  ATC  facilities;  and  respond  correctly  to  enroute  emergencies. 

Standards:  At  the  conclusion  of  this  lesson,  the  student  must  be  able  to 
demonstrate  his/her  ability  to  conduct  safe  solo  cross-country  flights  using 
various  means  of  navigation.  He/she  must  display  a  thorough  knowledge  of 
cross-country  flight  planning,  weather  analysis,  and  use  of  proper  aeronauti¬ 
cal  publications.  He/she  should  be  able  to  maintain  altitude  within  ♦_  200 
feet  and  heading  within  ^  1C  degrees  vrftlle  maintaining  the  proper  ground  track 
within  1  mile.  In  addition,  the  student  must  be  able  to  Identify  his/her 
position  at  all  times  and  be  able  to  give  a  reasonable  estimate  to  another 
1 ocatlon. 

LESSON  16  -  SOLO  CROSS-COUNTRY 


Objective:  The  student  will  conduct  a  three  leg,  round  robin,  solo  cross¬ 
country  Flight  using  pilotage,  dead  reckoning,  and  radio  navigation.  This 
flight  should  be  approximately  1.5  hours  duration  and  should  be  conducted  over 
the  same  route  as  Unit  #46  dual  cross-country. 

Standards:  The  student  must  successfully  complete  a  three  leg,  solo 
cross-country  flight  over  the  route  designated  by  the  flight  Instructor. 

LESSON  17  -  SOLO  CROSS-COUNTRY  PHASE  CHECK 


Objective:  To  determine  by  an  oral  exam  and  flight  check  that  the  stu¬ 
dent  TiasEfie- necessary  knowledge  and  competence  to  safely  plan  and  conduct  a 
solo  cross-country  flight,  to  Include  a  diversion  to  an  alternate  airport  and 
react  properly  to  unanticipated  emergencies. 
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LESSON  17  (Continued) 


Standards:  The  student  will  be  expected  to  demonstrate  his/her  ability 
to  safely  conduct  cross-country  operations  and  should  display  a  thorough 
knowledge  of  proper  preflight  action,  flight  planning,  weather  analysis,  and 
aeronautical  publications  available.  He/she  should  perform  all  duties  of 
pi lot- in-command  with  smoothness,  accuracy,  and  competence.  He/ she  should  be 
able  to  divert  to  an  alternate  airport  and  give  a  reasonable  estimate  of 
his/her  arrival  time  and  remaining  fuel.  Prior  to  arrival  at  the  alternate 
airport,  the  student  will  be  placed  under  the  hood  until  lost.  The  student 
should  be  able  to  locate  his/her  position  within  3  miles  without  aid  from  the 
instructor  by  using  all  means  available.  The  student  must  also  establish  and 
maintain  headings  required  to  stay  on  course,  correctly  Identify  his/her  posi¬ 
tion  at  all  times,  provide  reasonable  estimates  of  estimated  arrival  times 
with  apparent  errors  of  not  more  than  10  minutes,  maintain  altitude  200 
feet,  and  establish  a  course  to  an  alternate,  and,  within  a  reasonable  time, 
give  an  acceptable  estimate  of  the  time  and  fuel  required  to  reach  the  alter¬ 
nate. 

LESSON  18  -  SOLO  CROSS-COUNTRY 


Objective:  During  this  lesson,  the  student  will  conduct  a  three  leg, 
solo  cross-country  flight  with  a  landing  at  each  airport.  Route  of  the  flight 
and  airports  of  intended  landing  to  be  determined  by  the  Instructor. 

Standards:  This  lesson  will  be  complete  when  the  student  has  completed  a 
solo  cross-country  flight  (of  approximately  4.0  hours  duration)  to  two  air¬ 
ports  with  stops  at  each  airport.  The  instructor  will  conduct  a  post  flight 
critique  to  determine  that  all  required  flight  log  entries  have  been  made. 

LESSON  19  -  SOLO  CROSS-COUNTRY 

Objective:  During  this  lesson,  the  student  will  conduct  a  three  leg, 

solo  cross-country  flight  to  meet  FAR  Part  61,  B-2. 

Standards:  This  lesson  is  complete  vrtien  the  student  has  satisfactorily 
completed  a  solo  cross-country  flight  (approximately  4.5  hours  duration)  that 
has  landings  at  not  less  than  three  points,  each  of  which  is  more  than  100  NM 
from  the  other  points. 


PHASE  IV  -  PILOT  OPERATIONS  -  PRIVATE  PILOT 


OBJECTIVE 

The  student  will  receive  additional  Instruction  and  gain  further  experience 
and  competence  In  the  preparation  for  the  Private  Pilot  airplane  flight  test. 

STANDARDS 

This  phase  will  be  complete  when  the  student  successfully  passes  the  Private 
Pilot  Phase  Check  for  tills  course. 


LESSON  20  -  CERTIFICATE  REVIEW 


Objective:  During  this  lesson,  the  Instructor  will  determine  the 
student's  proficiency  In  all  maneuvers  and  procedures  necessary  to  conduct 
flight  operations  as  a  Private  Pilot. 

Standards:  The  student  should  display  the  ability  to  meet  the  requlre- 
ments  as  outlined  In  the  Private  Pilot  Flight  Test  Guide,  AC  61-54,  or  Its 
current  equivalent,  for  operations  as  a  Private  Pilot. 

LESSON  21  -  PRIVATE  PILOT  PHASE  CHECK 


Objective:  To  determine  by  an  oral  exam  and  a  flight  check  that  the  stu¬ 
dent  has  the  necessary  knowledge  and  skill  to  conduct  flight  operations  as  a 
Private  Pilot. 

Standards:  The  student  will  demonstrate  the  required  proficiency  and 
knowl edge  as  outl Ined  In  the  Private  Pilot  Flight  Test  Guide,  AC  61-54,  or  its 
current  equivalent. 

LESSON  22  -  FAA  PRIVATE  PILOT  CHECKRIDE 

Objective:  To  allow  the  student  and  Instructor  to  complete  the  necessary 
paperwork  and  certifying  procedures  so  that  the  student  can  apply  and  complete 
the  FAA  Private  Pilot  checkrlde  with  either  an  FAA  inspector  or  an  FAA 
designated  examiner. 

Standards:  The  student  can  make  application  for  the  FAA  Private  Pilot 
checkrlde  If:  he/she  has  successfully  completed  the  Private  Pilot  phase 
check,  has  successfully  passed  the  FAA  Private  Pilot  written  exam,  and  has 
completed  the  following  minimum  training  hours:  20.0  dual  hours  to  Include 
3.0  dual  cross-country  hours;  20.0  solo  hours  to  Include  10.0  solo  cross¬ 
country  hours;  1.0  hour  simulator  Instruction;  3.0  hours  observing;  and  3.0 
hours  In  test  preparation. 
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APPENDIX  C 


PILOT  PERFORMANCE  DESCRIPTION  RECORD  (PPDR) 


This  appendix  contains  a  facsimile  of  the  PPDR,  the  measure  used  In  the 
present  study  to  record  the  performance  of  the  students  during  the  flight 
checkrides.  The  rationale  underlying  the  development  of  the  PPDR  and  the 
procedures  for  Its  use  are  described  In  the  Methods  section.  The  PPDR  In  this 
appendix  contains  all  three  task  subsets  (I,  II,  and  III).  Table  1  In  the 
main  text  Identifies  the  specific  task  subsets  used  In  each  of  the  four  check- 
rides.  Appendix  D  contains  the  instructions  provided  to  the  checkpllots  to 
guide  their  use  of  the  PPDR. 

The  PPDR  was  produced  In  the  size  illustrated  In  this  appendix  to  facilitate 
its  use  In  the  aircraft  during  the  checkride.  Additionally,  holes  were 
punched  Into  the  PPDR  forms  to  enable  them  to  be  Inserted  into  loose  leaf 
binders. 
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2. 


WEATHER 


BEGINNING  Op  FLIGHT:  END  Or  FLIGHT: 


run  rran  m 

X  WINO 

15°  .  30*  45°  60° 

_J  _J  _J  _J 

m  f-fjcruEn  m 

X  WIND 

15°  30°  45°  60° 

_J  __1  1  1 

WINO 

S  10  15  20 

VELOCITY  till 
(Knts)  -  - * 

GUSTS  mn  fTTCRTl  tWT[ 

WIND  j 

5  10  15  2C 

velocity  |  J  _ |  _ 1 

(Knts)  j 

GUSTS  \  NONE"!  tTTGHT[  (“MODTl 

i 

3.  ROUTE  IDENTIFICATION: 


C-2 


CROSS  COUNTRY  PLANNING 


COURSE  IS  SELECTED,  DRAWN, 

AND  MEASURED  PROPERLY 

pre] 

rw i 

WEATHER  INFORMATION  IS 

PROPERLY  INTERPRETED 

rwrj 

rw| 

FLIGHT  LOG  IS  COMPLETED  PROPERLY 

PTT1 

nroi 

FLIGHT  PLAN  IS  COMPLETED  PROPERLY 

nm 

n&rj 

WEIGHT  AND  BALANCE  CALCULATIONS 
PERFORMED  PROPERLY 

pTTi 

rm 

FLIGHT  PLAN  IS  FILED  PROPERLY 

pm 

rwrf 

COMMENTS: 

( Describe  any  errors  in  above  procedures.) 
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ENGINE  START  PROCEDURES  ANO  PRETAX!  CHECX 


ENGINE  START  PROCEDURES  CORRECT  [~YT5~|  t~W] 

(If  any  step  is  omitted  or  performed  incorrectly,  please  list  it  below.) 


j  taxi  INC  TO  takeoff  position 


SRAKE  CHECK 

cm 

r^n 

PROPER  TAXI  SPEED 

pTTf 

n?n 

PROPER  DIRECTIONAL  CONTROL 

am 

cm 

PROPER  APPLICATION  OF  6 RAKES 

Cd 

nro-f 

PROPER  EXTERNAL  SCAN 

nm 

nnr| 

PROPER  CONTROL  POSITIONING 

tun 

rm 

PROPER  USE  OF  POWER 

!  yes  | 

cm 

GROUND  COMMUNICATION  PROCEDURES  (TO  TAKEOFF) 


CORRECT  FREQUENCY  TUNED 

cm 

pun 

PROPER  USE  OF  MIKE 

cm 

cm 

SPEAKS  CLEARLY 

cm 

pun 

MAKES  PROPER  REQUESTS 

rrn 

cm 

understands  MESSAGES 

cm 

cm 

COMPLIES  WITH  MESSAGES  WHILE 
PERFORMING  OTHER  TASKS 

cm 

cm 

COMMENTS:  (If  any  procedural  step  Is  omitted  or  performed  Incorrectly,  plea 

l  i st  ft  below.  See  "While  Taxiing”  checklist  for  these  steps.) 


ENGINE  RUNUP  ANO  BEFORE  TAKEOFF  CHECK 


BEFORE  TAKEOFF  PROCEDURES  CORRECT  pTTf 

(If  any  step  is  omitted  or  performed  incorrectly,  please  list  it  below.) 


GROUND  RUN 

FULL  THROTTLE 
RUNWAY  CENTERLINE  TRACK 


LIFTOFF 

AIRSPEED 

ACCEPTABLE  ROTATION 


CLIMBOUT 

AIRSPEED 

TRACK  FROM 
EXTENDED  RUNWAY 

PROPER  PATTERN  EXIT 

PROPER  TRIM  (FOR  CLIMB) 


LEVEL  OFF 
ALTITUDE 

TRIM  (LEVEL  FLIGHT) 


SMOOTH  CONTROL 
CONTROL  COORDINATION 


COMMENTS: 
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VOR  TRACKING  (CROSS  COUNTRY;  INBOUND) 


IDENTIFICATION 

STATION  TUNED 

PT5-J 

PROPERLY 

cm 

STATION  IDENTIFIED 

Dm 

rm 

RAOIAl  IDENTIFIED 

rrcn 

rwt 

ALTITUDE 

(DURING  IDENTIFICATION) 

-100 

1 

-50  _  +50 

UatfNJ 

♦100 

1 

HEADING 

(DURING  IDENTIFICATION) 

-10* 

1 

5*  +5* 

+10* 

1 

RACK  TO  STATION 

TURN  TO  INBOUNO 

HEADING 

-10 

1 

-5^ 

^+5 

+10 

1 

ALTITUDE 

-100 

1 

-50^ 

„  +50 

♦100 

1 

AIRSPEED 

-10* 

1 

-5*^ 

^+5* 

+10* 

.  1 

VOR  TRACK 
(1  1  dot) 

am 

cm 

TURBULENCE 

Dm 

rm 

COMMENTS: 


«c£*i  ;»**;*  ns 


**U9!«G 

<  3uair<«6  SM1TCM) 


4ACK  fC  STATION 

TURN  T0  OUTSOUNO 

HEADING 

-10 

j 

-s 

*:c 

i 

ALTITUDE 

-100 

1 

-50^^  *50 

♦100 

1 

AIRSPEED 

-10* 

! 

-5* 

^  ♦** 

IfcJ 

♦  10* 

1 

VOR  TRACK 
(1  1  dot) 

am 

USD 

TURBULENCE 

am 

rwt 

COMMENTS 


ESTIMATES  PROPER  HEADING 
CORRECTIONS  FOR  SECONO 
LEG  (OURING  FIRST  LEG) 


am  HTCH 

CORRECTLY  ESTIMATES  CORRECTED 


TIME  IN  ROUTE  FOR  SECONO  LEG 
{DURING  FIRST  LEG) 

r^q  ■ 

pnri 

ESTIMATES  fuel  REQUIRED  FROM 

FIRST  AIRPORT  TO  FINAL 

DESTINATION 

am 

rm 

LOCATES  FIRST  AIRPORT 

QH3 

am 

TURNS  ON  CORRECT  HEAOING 

FOR  NEXT  AIRPORT 

am 

r~wi 

I0MMENTS: 


DIVERSION  TO  ALTERNATE  FIELD 


DETERMINES  PROPER  HEADING  CORRECTION 
FOR  ALTERNATE  FIELD  (USES  COMPUTED 

nun 

WIND) 

TURNS  ON  CORRECT  HEADING  TO 

ALTERNATE  AIRPORT 

pnnn 

nraq 

COMPUTES  ETA  FOR  ALTERNATE 

AIRPORT 

r TCf 

nroi 

LOCATES  ALTERNATE  AIRPORT 

r^n 

nun 

VERBALIZES  COMMUNICATION 

REQUIREMENTS  FOR  CHANGE  IN 

prETT 

rm 

FLIGHT  PLAN 

COMMENTS: 
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MINIMUM  CONTROLLABLE  AIRSPEED 


ENTRY 


PROPER  ENTRY  PROCEDURES 

pnnrf 

rw} 

rRAIGHT  AND  LEVEL 

AIRSPEED 

-10 

I 

-5 

^  +5 

*10 

1 

ALTITUDE 

-100 

1 

-SO  +5C 

1 

+100 

1 

HEADING 

-10" 

1 

-5"  +5* 

+ 

>— ■ 
o 

• 

TURN 

-10 

-5 

_  +5 

+10 

AIRSPEED 

1 

j  ^ 

1 

ALTITUDE 

-100 
_ 1 

-50 

+50 

+100 

1 

RECOVERY 

PROPER  RECOVERY  PROCEDURES 

DggJ 

cm 

PROPER  USE  OF  POWER 

am 

cm 

SMOOTH  CONTROL 

mi 

cm 

TURBULENCE 

mi 

cm 

OMMENTS: 


;■?’<  1“  fT*?.'*niJi  -^rn<f^>up^i9«tnti!.^-Tn»TfR|n?v«7^f 


I  TAKEOFF  AND  DEPARTURE  STALL 

ENTRY 

PROPER  ENTRY  PROCEDURES 

AIRSPEED 


rron  iutn 

55 

-5  ^  +5 

LOW  I  I 


HIGH 


RECOVERY 

STALL  RECOGNIZED 

prrri 

m 

PITCH  DECREASED 

am 

nan 

WINGS  LEVEL 

tun 

HKT[ 

ALTITUDE  LOSS  ACCEPTABLE 

am 

HKH 

AIRSPEED  NOT  EXCESSIVE 

am 

am 

SMOOTH  CONTROL 

am 

rm 

TURBULENCE 

am 

am 

COMMENTS: 


C- 14 


ENTRY 


SCOVERY 

STALL  RECOGNIZED 

FULL  THROTTLE 
PITCH  DECREASED 

WINGS  LEVEL 

CARB  HEAT  OFF 

FLAP  RETRACTION 
ALTITUDE  LOSS  ACCEPTABLE 

AIRSPEED  NOT  EXCESSIVE 
SMOOTH  CONTROL 


am 

[YETI 

rron 

am 

rron 


Dm 


am 


am 

r® 

am 

am 

nr f 

nn 

am 

run 

am 

am 


TURBULENCE 


rrrn 


STEEP  TURNS  (720*) 


~NTRY 

PROPER  ROLL  IN 

PROPER  USE  OF  POWER 

AIRSPEED 

ALTITUOE 

BANK/TURN 

ANGLE  BANK 

AIRSPEED 


ALTITUOE 


RECOVERY 


PROPER  LEAD 

ALTITUDE 

HEAOING 

AIRSPEED 

PROPER  POWER  REDUCTION 
SMOOTH  CONTROL 

TURBULENCE 


OMMENTS: 


tr  ret -jjaif^sw  ywf  |wb  «.ijvh«  j 


■-<  J  iltret^Vr*! Ji^! }«t*s«iij4»l»f-.Y 


I  ACCELERATED  STALL 


ENTRY 


AREA  CLEARED 

rm 

nun 

MIXTURE  RICH 

rm 

rm 

-100  -50  ^ 

+50  +100 

POWER  (RPM) 


ALTITUOE 


-100  -SO  +50  *100 

J  I  I _  I _ 


BANK 


INITIATE  AT  55  KIAS  (1  5  KNOTS)  fTETt  PUT] 


BANK  ANGLE 


ALTITUDE 


+100 


RECOVERY 


STALL  RECOGNIZED 

am 

rm 

PITCH  DECREASED  PROPERLY 

rm 

nun 

WINGS  LEVELLED  PROPERLY 

am 

rm 

FULL  POWER 

mm 

rm 

CARB  HEAT  COLD 

cm 

rm 

PROPER  CONTROL 

COORDINATION 

cm 

pun 

SMOOTH  CONTROL 

cm 

cm 

TURBULENCE 

cm 

cm 

COMMENTS: 


C- 18 


I  ENGINE  FAILURE  PROCEDURES  DURING  FLIGHT 


ENGINE  FAILURE  PROCEDURES  CORRECT  P^T|  [~~Wrf 

AIRSPEED  -  65  KIAS  (±  2  KNOTS)  |  f 

CAR8  HEAT  ON  |  [ 

FUEL  SELECTOR  VALVE  ON  BOTH  f  | 

MIXTURE  RICH  |  [ 

IGNITION  SWITCH  ON  BOTH  |  | 


CH 


PRIMER  -  IN  AND  LOCKED 


1 


(MMW'll.tVliiyi  nf^vu^< 


FORCED  LANDING 


SELECTS  FEASIBLE  AREA  FOR 

frcri 

EMERGENCY  LANDING 

rwi 

PROPERLY  PLANS  DIRECTION  OF 

prcrf 

LANDING 

rw i 

PROPER  AIRSPEED  CONTROL  (NOT 

EXCESSIVELY  HIGH  OR  LOW) 

m t] 

rm 

MAINTAINS  SCAN  FOR  HIGH  OBSTACLES 

rwi 

rw] 

WOULD  OBTAIN  DESIRED  TOUCHOOWN  POINT 

vim 

rm 

VERBALIZED  PROCEDURES  FOR 

rm 

EMERGENCY  LANDING 

pnrf 

C  1MMENTS: 


C-20 


GO-AROUNO  PROCEDURES 


GO-AROUND  PROCEDURES  CORRECT  pT5~[  fHITI 

THROTTLE  -  FULL  POWER  | - [ 

PITCH  ATTITUDE  CHANGED  cm 

CARS  HEAT  COLD  cm 

FLAPS  20*  MAXIMUM  cm 

CLIMB  55  KIAS  (±  5  KIAS)  cm 

FLAPS  RETRACTED  PROPERLY  cm 


COMMENTS: 


BEFORE  LANDING  PROCEDURES 


BEFORE  UNDING  PROCEDURES  CORRECT  [""MTf 

SEATS,  BELTS,  HARNESSES  SECURE  |  | 

FUEL  SELECTOR  VALVE  ON  BOTH  |  | 

MIXTURE  RICH  I  [ 

CARS  HEAT  ON  CH 


COMMENTS: 


C-22 


3 

'j 


W  .  1,i'  II*'  ;  ■  -I'M 


C-23 


TRAFFIC  PATTERN  (UNCONTROLLED  F 


BASE 

AIRSPEED 

PROPER  GROUND  TRACK 
PROPER  FLAPS 
TURN  STARTED  (FINAL) 
TRIM 
"INAL 

TRACK  FROM 
EXTENOEO  RUNWAY 

AIRSPEED 
DESCENT  RATE 
APPROACH  ANGLE 
PROPER  FLAPS 
TRIM 

SMOOTH  CONTROL 
TURBULENCE 


f 

} 

! 


COMMENTS: 


NORMAL  LANDING  (UNCONTROLLED  FIELD) 


TRANSITION  (FLARE) 

ALTITUDE 

-10 

1 

-5 

20 

1 

+10 

I 

PROPER  FLARE  RATE 

PROPER  FLARE  ATTITUDE 

pETt 

am 

am 

cm 

DUCHDOWN 

TOUCHDOWN  POINT 

SHORT 

_ u 

ilS^hkJ. _ 

LONG 

PROPER  POWER 

PROPER  NOSE 

ATTITUDE 

prcrf 

Rcri 

cm 

rm 

CONTACT 

DROP 

_ Li 

_ 

BOUNCE 

RUNWAY  CENTERLINE 

TRACK 

LEFT 

_ U 

RIGHT 

SMOOTH  CONTROL 

pTT| 

am 

TURBULENCE 

am 

QQ 

COMMENTS: 


C-25 


GROUND  RUN 


FULL  THROTTLE 

rrcrj 

cm 

RUNWAY  CENTERLINE 

TRACK 

LEFT  Lrfig 

fcbd  »oht 

LIFTOFF 

-6 

+s 

AIRSPEEO 

low 

HIGH 

ACCEPTABLE  ROTATION 

rrorf 

cm 

CLIMBOUT 

•s  , 

.  +s 

INITIAL  AIRSPEEO  (OVER  OBSTACLE) 

_ low 

fehJ _ high 

-5 

+5 

AIRSPEED  (AFTER  OBSTACLE  CLEARED) 

LOW 

^  1  HIGH 

TRACK  FROM  EXTENDED  RUNWAY 

LEFT 

^  I  RIGHT 

PROPER  TRIM  (FOR  CLIMB) 

cm 

cm 

LEVEL  OFF  (IN  PATTERN) 

ALTITUDE 

_ low 

fek.  1  HIGH 

TRW  (LEVEL  FLIGHT) 

csa 

cm 

TRW  (LEVEL  FLIGHT) 


SMOOTH  CONTROL 


CONTROL  COORDINATION 


TURBULENCE 


COMMENTS: 


SHORT  FIELD  LANDING  (BASE  AND  FINAL) 


BASE 

AIRSPEED 

-10 

-5 

+S 

aswi 

+10 

I 

PROPER  GROUND  TRACK  (EXTENDED) 

PROPER  FLAPS 

TURN  STARTED  (FINAL) 

EARLY 

am 

am 

mrj 

nm 

bhJ 

LATE 

TRIM 

am 

rwj 

FINAL 

TRACK  FROM 

EXTENDED  RUNWAY 

LEFT 

RIGHT 

AIRSPEED 

-10 

_i  - 

-5  ^ 

^♦5 

+10 

1 

DESCENT  RATE 

SLOW 

W! 

FAST 

APPROACH  ANGLE 

SHALLOW  I 

STEEP 

am 


PROPER  FLAPS 


nrcn 


SHORT  FIELD  LANDING  (TRANSITION  AND  TOUCHDOWN) 


TRANSITION  (PURE) 

ALTITUDE 

-10 

-5 

20 

^  +5 

+10 

1 

PROPER  FLARE  RATE 

nrrj 

cm 

PROPER  PURE  ATTITUDE 

pTTf 

cm 

TOUCHDOWN 

TOUCHDOWN  POINT 

SHORT 

1 

LONG 

PROPER  POWER 

nm 

moi 

PROPER  NOSE 

cm 

ATTITUDE 

pnr| 

CONTACT 

DROP 

BOUNCE 

RUNWAY  CENTERLINE 

TRACK 

LEFT 

L- 

RIGHT 

PROPER  USE  OF  8 RAKES 

peri 

mn 

SMOOTH  CONTROL 

cm 

cm 

TURBULENCE 

Cm 

DEI 

COMMENTS: 


C-29 


SOFT  FIELD  TAKEOFF 


GROUND  RUN 


PROPER  USE  OF  FLAPS 

r^n 

nnq 

INITIATED  ROLLING  START 

rrert 

rw] 

FULL  THROTTLE 

r^rf 

rnr| 

RUNWAY  CENTERLINE 

TRACK 

LEFT 

RIGHT 

LIFTOFF 

AIRSPEED  AT  LIFTOFF 

•6 

LOW  1 

+5 

fekJ  HIGH 

ACCEPTABLE  ROTATION 

rrcrf 

pRTf 

CLIMBOUT 

MAINTAINS  PROPER  ATTITUDE  UNTIL 
AIRSPEED  BUILOS 

am 

cm 

AIRSPEED  (AFTER  STARTING 

CLIMBOUT) 

-5  ^  *5 

LOW  1  HIGH 

- 

TRACK  FROM  EXTENDED  RUNWAY 

LEFT 

^  !  RIGHT 

■ 

1 

PROPER  TRIM  (FOR  CLIMB) 

Q53 

cm 

C-30 


LEVEL  OFF  (IN  PATTERN) 


ALTITUOE 

LOW  HIGH 

TRIM  (LEVEL  FLIGHT) 

Om 

am 

SMOOTH  CONTROL 

am 

053 

CONTROL  COORDINATION 

am 

rm 

rsurr 


TURBULENCE 


am 


am 


CROSSWINO  LANDING  (BASE  AND  FINAL) 


BASE 


AIRSPEED 

-10 

1  . 

-5  ^ 

+5 

bhJ 

+10 

.  1 _ 

PROPER  GROUNO  TRACK 

rroi 

HIT] 

PROPER  FLAPS 

HTT] 

proi 

TURN  STARTED  (FINAL) 

EARLY 

L 4* 

^.1 

LATE 

TRIM 

prri 

t=H 

INAL 

PROPER  DRIFT  CORRECTION 

1 nsa 

TRACK  FROM 

EXTENDED  RUNWAY 

LEFT 

\^k 

RIGHT 

AIRSPEED 

-10 

1  . 

-5^ 

_ 

^  +5 

+10 

.  I _ 

DESCENT  RATE 

SLOW 

_ 

FAST 

APPROACH  ANGLE 

SHALLOW  I 

bbj 

STEEP 

PROPER  FLAPS 

r^n 

cm 

PROPER  FLAPS 


CROSSWIND  LANDING  {TRANSITION  AND  TOUCHDOWN) 


TRANSITION  (FLARE) 

ALTITUOE 

PROPER  PURE  RATE 
PROPER  FLARE  ATTITUDE 
PROPER  ORIFT  CORRECTION 


20 

-10  -5  +5  +10 

_i  i  i  L 

am  rwn 

rrrn  rmn 

rrcrr  .  rnoi 


TOUCHDOWN 

TOUCHDOWN  POINT  SHORT  j _ LONG 


PROPER  POWER 

Pm 

PROPER  NOSE 

ATTITUDE 

rren 

PROPER  DRIFT  CORRECTION 

CHI 

CONTACT 

DROP 

i  ^ 

^  1  BOUNCE 

RUNWAY  CENTERLINE 
.TRACK 

LEFT 

^  1  RIGHT 

PROPER  USE  OF  BRAKES 

SMOOTH  CONTROL 

CE1 

OH 

TURBULENCE 

am 

rwrr 

COMMENTS 


CROSSWINO  TAKEOFF 


GROUND  RUN 


FULL  THROTTLE 

am 

nun 

FULL  AILERON  DEFLECTION 

am 

nun 

RUNWAY  CENTERLINE  TRACK 

LEFT 

1, 

RIGHT 

LIFTOFF 

-s 

+5 

AIRSPEED 

LOW 

I. 

HIGH 

ACCEPTABLE  ROTATION 

am 

m<n 

PROPER  DRIFT  CORRECTION 

am 

nm 

CLIMBOUT 

-5 

+s 

AIRSPEED 

LOW 

1. 

HIGH 

TRACK  FROM  EXTENOED  RUNWAY 

LEFT 

I, 

^  , 

RIGHT 

PROPER  TRIM  (FOR  CLIMB) 

am 

am 

LEVEL  OFF 

ALTITUDE 

LOW 

i. 

i 

HIGH 

TRIM  (LEVEL  FLIGHT) 

am 

DED 

SMOOTH  CONTROL 

am 

am 

CONTROL  COORDINATION 

am 

□El 

,  17  ,1, 
rsrnn  mom 

TURBULENCE 

am 

cm 

COMMENTS : 


C-34 


TURN  TO  ASSIGNEO  HEADING 


BANK  ANGLE 

-10* 

! 

♦  10* 

1 

ALTITUDE 

-100 

1 

-SO  +50 

+100 

1 

AIRSPEED 

-10 

i 

-s^+s 

+10 

1 

ROLLOUT  ON 

ASSIGNED 

-10* 

I 

-5*^^  +5* 

+10* 

1 

HEADING 

SMOOTH 

CONTROL 

csa  cm 

TURBULENCE 

CHS  QS 

COMMENTS: 


C-35 


I  STRAIGHT  AND  LEVEL  F 

AIRSPEED 

HEADING 

ALTITUOE 

PROPER  TRIM 

SMOOTH  CONTROL 

TURBULENCE 


COMMENTS: 


ENTERS  DOWNWIND 

nrcrf 

ruin 

ist  turn 

altitude 

-100 

1 

-so^ 

♦50 

J  . 

♦100 

1 

AIRSPEED 

-10 

1 

-5 

♦5 

J 

♦10 

1 

CORRECT  BANK  ANGLES 

FOR  DRIFT  CORRECTION 

mn 

Cm 

WINGS  LEVEL  AT  ROAD 

pftri 

cm 

'n<l  TURN 

ALTITUDE 

-100 

I 

-50^^ 

♦50 

J 

♦100 

I 

AIRSPEED 

-10 

1 

♦5 

.! 

♦10 

1 

CORRECT  SANK  ANGLES 

FOR  DRIFT  CORRECTION 

cm 

cm 

SMOOTH  CONTROL 

CUE 

cm 

COOROINATEO  TURNS 

cue 

cm 

TURBULENCE 

HETT 

cm 

COjfCjjTS; 


C-37 


ENTER  DOWNUINO 


cm  cm 


st  TURN 
ALTITUDE 


AIRSPEED 


2nd  TURN 
ALTITUDE 

AIRSPEED 

CONSTANT  RADIUS 
TURN 

PROPER  EXIT 
HEADING 


MAINTAIN  AIRSPACE  SCAN 

023 

cm 

SMOOTH  CONTROL 

os 

cm 

TURBULENCE  pTETI  l~Wt 


COM>CNTS 


INITIATE 


POWER  INCREASE  (RPM) 

-100 

1 

-50 

l^fg 

+50 

+100 

I 

AIRSPEED 

-10 

! 

-5^  ^ 

+5 

! 

+10 

! 

HEADING 

-10* 

1 

-5*  ^ 

+5* 

+10* 

1 

MAINTAIN 

VERTICAL  SPEED  (FPM) 

-100 

! 

-50 

1^ 

^+50 

+100 

L 

HEADING 

-10* 

1 

-5*  ^ 

^+5* 

+10° 

! 

-EVELOFF 

HEADING 

-10' 

J 

^+5* 

• 

o _ 

•H 

+ 

ASSIGNED  ALTITUDE 

-100 

1 

.  V 

-50  - 

+50 

+100 

I 

SMOOTH  CONTROL 

am 

pnrf 

TURBULENCE 

cm 

cm 

COMMENTS 


MAGNETIC  COMPASS  TURN  (W-S;  270*)  (HOOD) 


SETUP 

PROPER  SETUP 

ROLLIN 

BANK 


to  rm 


-5*  _  +5*  +10* 


ALTITUDE 


-50  +50  +100 


MAINTAIN 

3ANK 


-5*  _  +5* 


ALTITUDE 


-50  +50  +100 


ROLLOUT 

ALTITUDE 


DEGREES 

TURNED 

PROPER 

LEAO/LAG 


-50  _  +50  +100 


270 

-5*  +5*  +10* 


tot]  rm 


SMOOTH 

CONTROL 

urn 

rm 

TURBULENCE 

□ee 

cm 

COMMENTS: 


C-40 


RECOGNITION 

RECOGNITION  OF 


ATTITUDE 

pwi 

RECOVERY 

CORRECT  AND  TIMELY 

CONTROL  MOVEMENTS 

rrarf 

mn 

INITIAL  ALTITUDE 

RECOVERED 
(1  100ft.) 

pren 

nun. 

HEADING  CONTROL  (RECOVERY) 

rreq 

pnr| 

SMOOTH  CONTROL 

am 

P«n 

TURBULENCE 

am 

nrf 

COMMENTS: 


C-41 


180*  TURNS  (HOOD) 


PROPER  ROLL  IN 

cm 

piq 

BANK  ANGLE 

-10* 

...  1 

-5*  ^ 

♦5* 

1 

+10* 

1 

ALTITUDE 

-100 

...  J 

*so 

+50 

EfcJ 

+100 

1 

AIRSPEED 

% 

-10 

1 

^  +5 

+10 

I 

ROLLOUT  ON 

ASSIGNED 

-10* 

1 

-5*^ 

+5* 

+10* 

1 

HEADING 

SMOOTH 

CONTROL 

pirf 

pun 

TURBULENCE 

HETf 

cm 

COMMENTS: 


C-42 


DECELERATION  (CRUISE  TO  70  KIAS) 

PROPER  POWER  DECREASE 

□m 

cm 

HEADING 

-20 

-10  ^ 

+10 

+20 

1 

ALTITUDE 

-100 

-so  ^ 

1  --dff 

^  +50 

+100 

1 

ASSIGNED  AIRSPEED  (±  3  KIAS) 

pm 

run 

ACCELERATION  (70  KIAS  TO  CRUISE) 

PROPER  SETUP 

prcrf 

rwrf 

PROPER  POWER  INCREASE 

rwrj 

HEADING 

-20 
_ 1 

-10^ 

+10 

+20 

1 

ALTITUDE 

-100 

_ l 

-50  ^ 

+50 

1 

+100 

1 

ASSIGNED  AIRSPEED  (1  3  KIAS) 

pm 

cm 

SMOOTH  CONTROL 

Dm 

cm 

TURSUIENCE 

Dm 

run 

COMMENTS: 


C-43 


|  VOR  TRACKING  (HOOD) 


IDENTIFICATION 


STATION  TUNED 

PROPERLY 

r^n 

cm 

STATION  IDENTIFIED 

nran 

rm 

RADIAL  IDENTIFIED 

ALTITUDE 


HEADING 


RACK  TO  STATION 


VOR  TRACK  _ _  _ 

(1 1  dot)  HTTt  rwr 


SMOOTH  CONTROL 

tun 

CH 

TURBULENCE 

rrcri 

rm 

COMMENTS: 


C-44 


ENTRY 


ANGLE  (45*) 
ABEAM  MIDPOINT 

ALTITUDE 

RPM 

DISTANCE  OUT 


DOWNWIND 

ALTITUDE 

-100  -50  ^ 

^+50 

<■100 

1 

COCKPIT  CHECK 

nz n 

cm 

REDUCE  POWER 

EARLY  1 ^ 

^  1 

LATE 

AIRSPEED 

-10  -5  ^ 

.  ♦« 

fe^l 

+10 

1 

FLAPS  (10*) 

nn 

rwn 

PROPER  GROUND  TRACK 

133 

can 

TURN  STARTED  (BASE) 

EARLY  1 

Wl 

LATE 

am 

mq 

nrrf 

RTf 

-100 

_1  _ 

-50 

L^l 

*  +so 

+100 

L_ 

-100 

_i  _ 

-50  ^ 

^  +5° 

0WI 

♦100 

L_ 

TOO 

CLOSE 

_ 

TOO 

FAR 

C-45 


TRAFFIC  PATTERN  (CONTROLLED  FIELD) 


BASE 

AIRSPEED 

-10  -S  ^ 

♦10 

1 

PROPER  GROUND  TRACK 

rypsi 

pur] 

PROPER  FLAPS 

prrq 

cm 

TURN  STARTED  (FINAL) 

EARLY  1 

LATE 

TRIM 

fWf 

cm 

FINAL 

TRACK  FROM 

EXTENOEO  RUNWAY 

LEFT  1  ^ 

RIGHT 

AIRSPEED 

-10  -5  ^ 

^  *5 

♦10 

.  1 _ 

DESCENT 

SLOW  1 

FAST 

APPROACH  ANGLE 

SHALLOW  ! 

^1 

STEEP 

PROPER  FLAPS 

QD3 

□S3 

TRIM 

am 

am 

'OHCNTS: 


C-46 


TRANSITION  (FLARE) 


20 


ALTITUDE 

-10 

1 

-5 

1  ^ 

+5 

^1 

♦10 

1 

PROPtR  PURE  RATE 

rrerf 

053 

PROPER  FLARE  ATTITUDE 

□S3 

pnrf 

TOUCHDOWN 

TOUCHDOWN  POINT 

SHORT 

I  ^ 

I 

LONG 

PROPER  POWER 

HETl 

rwi 

PROPER  NOSE 

ATTITUDE 

□S3 

053 

CONTACT 

DROP 

i  ^ 

^  l 

BOUNCE 

RUNWAY  CENTERLINE 

TRACK 

LEFT 

_ 

RIGHT 

SMOOTH  CONTROL  HETl  PTOTT 


TURBULENCE  PESl  PSPl 


COMMENTS : 


C-47 


BRAKES  CHECKED 

am 

rm 

PROPER  TAXI  SPEED 

am 

cm 

PROPER  DIRECTIONAL  CONTROL 

am 

cm 

PROPER  APPLICATION  OF  BRAKES 

am 

cm 

PROPER  POWER  APPLICATION 

am 

cm 

PROPER  EXTERNAL  SCAN 

rrcrf 

cm 

PROPER  CONTROL  POSITIONING 

am 

rmn 

{  GROUND  COMMUNICATION  PROCEDURES  (AFTER  LANDING) 


CORRECT  FREQUENCY  TUNED 

am 

cm 

PROPER  USE  OF  MIKE 

am 

cm 

SPEAKS  CLEARLY 

am 

cm 

MAKES  PROPER  REQUESTS 

am 

cm 

UNDERSTANDS  MESSAGES 

am 

cm 

COMPLIES  WITH  MESSAGES  WHILE 
PERFORMING  OTHER  TASKS 

am 

cm 

COMMENTS: 


C-48 


SECURING  AIRPLANE  PROCEDURES 


SECURING  AIRPLANE  PROCEDURES  CORRECT 

PARKING  BRAKE  SET 

AVIONICS  POWER  SWITCH/ ELECTRICAL 
EQUIPMENT  OFF 

MIXTURE  -  IDLE  CUT-OFF 

IGNITION  SWITCH  -  OFF 

MASTER  SWITCH  -  OFF 

CONTROL  LOCK  INSTALLED 

COMMENTS: 


am 


C-49 


B  D  D  D  D  0  0 


Sj*S>¥ 


APPENDIX  D 

STUDENT  OPINION  SURVEY 


This  appendix  contains  a  copy  of  the  Student  Opinion  Survey  that  mbs  given  to 
the  students  after  they  had  completed  the  fourth  checkrlde.  Procedures  for 
admlnl strati on  of  the  survey  are  described  In  the  Methods  section  of  the  main 
text. 
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To  be  completed  after 
the  fourth  checkrlde 

STUDENT  OPINION  SURVEY 

NAME:  _  Soc.  Sec.  Number:  _ _ 

The  purpose  of  this  survey  Is  to  obtain  your  opinion  of  the  Pilot  Evalua¬ 
tion  Program.  Your  answers  to  these  questions  will  be  used  to  aid  in  the 
determination  of  the  effects  of  the  distribution  of  flying  and  training  time 
on  private  pilot  instruction.  Additionally,  your  opinion  is  sought  concerning 
the  Influence  of  participation  In  the  Program,  regardless  of  the  experimental 
group  In  which  you  were  put,  on  the  performance  of  your  job  with  the  FAA. 

Your  answers  will  remain  anonymous.  That  Is,  answers  given  by  specific 
Individuals  will  not  be  discussed  with  their  Instructors  or  with  FAA  person¬ 
nel.  Your  name  is  needed,  however,  to  enable  the  Information  obtained  from 
this  survey  to  be  analyzed  with  respect  to  the  other  data  collected  during 
this  study— e.g.,  the  flight  check  data. 

Most  of  the  following  questions  have  multiple  choice  answers.  Circle  the 
number  of  the  alternative  that  you  select. 


1.  In  general,  how  difficult  was  the  training  you  received? 


1.  Very  easy 

2.  Easy 

3.  Moderately  easy 

4.  Moderately  hard 

5 .  Hard 

6.  Very  hard 

2.  How  pleasant  did  you  find  private  pilot  training  In  general? 

1.  Very  unpleasant 

2.  Unpleasant 

3.  Moderately  unpleasant 

4.  Moderately  pleasant 

5.  Pleasant 

6.  Very  pleasant 

3.  How  much  effort  did  you  usually  devote  to  preparing  for  training  flights? 

1.  None  at  all 

2.  Very  little 

3.  A  little 

4.  A  moderate  amount 

5.  A  substantial  amount 

6.  An  extreme  amount 

4.  In  general,  how  much  more  time  would  you  like  to  have  had  to  prepare  for 
your  training  flights? 

1.  None  at  all 

2.  Very  little  more 

3.  A  little  more 

4.  A  moderate  amount  more 

5.  A  substantial  amount  more 

6.  An  extreme  amount  more 

5.  (a)  How  pleasant  did  you  find  flying  to  be  during  your  first  three  solos? 

1«  Very  unpleasant 

2.  Unpleasant 

3.  Moderately  unpleasant 

4.  Moderately  pleasant 

5.  Pleasant 

6.  Very  pleasant 

(b)  How  pleasant  do  you  ..id  flying  solo  to  be  now? 

1.  Very  unpleasant 

2.  Unpleasant 

3.  Moderately  unpleasant 

4.  Moderately  pleasant 

5.  Pleasant 

6.  Very  pleasant 
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6.  How  frequently  did  you  become  nervous  or  anxious  while  flying  solo  during 
your  training? 

1.  Not  at  all 

2.  Very  little 

3.  A  little 

4.  A  moderate  amount 

5.  A  substantial  amount 

6.  An  extreme  amount 

7.  (a)  In  general,  how  much  has  your  participation  In  the  Pilot  Evaluation 

Program  aided  you  In  the  performance  of  your  job  at  the  Technical 
Center? 

1.  Not  at  all 

2.  Very  little 

3.  A  little 

4.  A  moderate  amount 

5.  A  substantial  amount 

6.  An  extreme  amount 

(b)  If  you  feel  your  participation  In  this  program  has  aided  you  In  the 
performance  of  your  job,  please  describe  some  examples  of  how  this 
experience  has  been  of  use. 


8.  How  much  do  you  feel  your  Immediate  supervisor  believes  your  participation 
In  this  Pilot  Evaluation  Program  has  aided  you  In  the  performance  of  your 
job  at  the  Technical  Center? 

1.  Not  at  all 

2.  Very  little 

3.  A  little 

4.  A  moderate  amount 

5.  A  substantial  amount 

6.  An  extreme  amount 

9.  In  general,  how  much  do  you  feel  your  participation  In  the  Pilot  Evalua¬ 
tion  Program  distracted  you  from  your  job  at  the  Technical  Center? 

1.  Not  at  all 

2.  Very  little 

3.  A  little 

4.  A  moderate  amount 

5.  A  substantial  amount 

6.  An  extreme  amount 
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10.  How  much  do  you  feel  your  Immediate  supervisor  believes  you  were  dis¬ 
tracted  from  your  job  at  the  Technical  Center  by  your  participation  In 
the  program? 

1.  Not  at  all 

2.  Very  little 

3.  A  little 

4.  A  moderate  amount 

5.  A  substantial  amount 

6.  An  extreme  amount 

11.  How  much  do  you  feel  flight  and  ground  school  training  distracted  you  from 
activities  connected  with  your  home  life  and  other  leisure  time  pursuits? 

1.  Not  at  all 

2.  Very  little 

3.  A  little 

4.  A  moderate  amount 

5.  A  substantial  amount 

6.  An  extreme  amount 

12.  (a)  How  much  more  frequently  would  you  like  to  have  flown  during  your 

training  (l.e.,  maintaining  the  same  total  number  of  flight  hours, 
but  flying  more  frequently  each  week)? 

1.  I  would  not  like  to  have  flown  more  frequently 

2.  Very  lltFTe  more 

3.  A  little  more 

4.  A  moderate  amount  more 

5.  A  substantial  amount  more 

6.  An  extreme  amount  more 


(b)  If  you  would  have  liked  to  have  flown  more  frequently,  please  state 
why. 


13.  (a)  How  much  less  frequently  would  you  like  to  have  flown  during  your 
training  TTTe.,  maintaining  the  same  total  number  of  flight  hours, 
but  less  frequently  each  week)? 

1.  I  would  not  like  to  have  flown  less  frequently 

2.  Very  little  less 

3.  A  little  less 

4.  A  moderate  amount  less 

5.  A  substantial  amount  less 

6.  An  extreme  amount  less 
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(b)  If  you  would  have  liked  to  have  flown  less  frequently,  please  state 
why . 


14.  How  much  trouble.  If  any,  did  you  have  remembering  what  you  had  learned  on 
previous  flights  during  later  flights? 

1.  None  at  all 

2.  Very  little 

3.  A  little 

4.  A  moderate  amount 

5.  A  substantial  amount 

6.  An  extreme  amount 

15.  (a)  How  much  do  you  plan  on  flying  after  you  receive  your  private  pilot's 

1 Icense? 

1.  None 

2.  An  average  of  1-4  hours  a  month 

3.  An  average  of  5-10  hours  a  month 

4.  An  average  of  10-20  hours  a  month 

5.  An  average  of  20-40  hours  a  month 

6.  An  average  of  more  than  40  hours  a  month 

(b)  If  you  marked  alternative  1,  please  circle  all  of  the  reasons  why  you 
will  not  fly. 

1.  I  don't  like  flying 

2.  I  don't  like  flying  as  much  as  other  activities  In 
which  I  can  engage 

3.  High  costs 

4.  Lack  of  time 

5.  No  reasons  to  fly 

6.  Spouse  does  not  want  me  to  fly 

7.  Other  (please  describe): 


(c)  If  you  do  plan  to  fly,  but  feel  you  will  probably  not  fly  as  much  as 

of  the  reasons  why  you  wTTT  probably 


1.  High  costs 

2.  Lack  of  time 

3.  Would  rather  do  other  activities 

4.  No  way  to  justify  flying  more  often 

5.  Spouse  does  not  want  me  to  fly 

6.  Weather 

7.  Other  (please  describe): 


you  will  want,  please  circle  all 
not  fly  as  much  as  you  want. 


17.  (a)  How  muon  overall  benefit  do  you  feel  the  Pilot  Evaluation  Program 
(across  all  students)  will  be  to  the  FAA? 

1.  None  at  all 

2.  Very  little 

3.  A  little 

4.  A  moderate  amount 

5.  A  substantial  amount 

6.  An  extreme  amount 

(b)  State  the  reasons  for  your  answer. 


18.  (a)  Circle  the  number  along  the  line  between  each  pair  of  words  to  Indi¬ 
cate  your  feelings  toward  the  training  you  received  in  the  aircraft. 


Hard 

1 

2 

3 

4 

5 

6 

Easy 

Effective 

I 

2 

'  3 

4 

5 

6 

Ineffective 

Efficient 

r~ 

2 

3 

4 

5 

T 

Inefficient 

Interesting 

1 

2 

3 

4 

0 

Uninteresting 

Job  relevant 

T 

2 

3 

4 

5 

t 

Not  job  relevant 

Inspiring 

1 

2 

y 

4 

5 

ST 

Uninspiring 

Thorough 

1 

L 

3 

"4 

b 

b 

Incomplete 

Organized 

1 

2 

3 

4 

5 

5" 

Unorganized 

Friendly 

I 

2 

3 

4 

5 

T 

Unfriendly 

Harried 

I 

z 

3 

4 

b 

T 

Leisurely 

PI easant 

I 

2 

3 

4 

5 

“nr 

Unpl easant 

(b)  Circle  the  number  along  the  line  between  each  pair  of  words  to  Indl- 


Hard 

Effective 

Efficient 

Interesting 

Job  relevant 

Inspiring 

Thorough 

Organ 1  zed 

Friendly 

Harried 

Formal 

Pleasant 


1 

2 

3 

4 

5 

6 

l 

2 

3 

4 

b 

S’ 

T 

2 

3 

4 

S 

T 

r~ 

2 

3 

4 

£ 

“T 

i 

2 

3 

4 

b 

5 

T~ 

2 

3 

4 

b 

6 

I 

2 

3 

4 

5 

S 

1 

'2 

3 

4 

b 

b 

I 

2 

3 

5 

T 

r~ 

2 

3 

4 

5 

6 

t 

Z 

3 

4 

b 

T 

r~ 

2 

3 

4 

5 

S’ 

Easy 

Ineffective 

Inefficient 

Uninteresting 

Not  job  relevant 

Uninspiring 

Incomplete 

Unorganized 

Unfriendly 

Leisurely 

Informal 

Unpl  easant 
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19.  Please  rate  the  difficulty  you  experienced  In  learning  to  perform  the 
following  tasks  correctly.  Use  the  following  6-polnt  scale. 

1.  I  experienced  no  difficulty. 

2.  I  experienced  very  little  difficulty. 

3.  I  experienced  a  little  difficulty* 

4.  I  experienced  a  moderate  amount  of  difficulty* 

5.  I  exoerlenced  a  substantial  amount  of  difficulty. 

6.  I  experienced  tfh  CTtNRK  ’Omr ST  difficulty. 


Circle  the  number  that  best  indicates  how  much  difficulty  you  had  In 


learning  to  perform  each  of  these 


TASKS  NONE 

a.  Planning  a  cross-country  1 
trip 

b.  Conducting  an  engine  run-up  1 


and  before  takeoff  check 

c.  Taking  off  and  departing  1 
from  ACY 

d.  Tracking  a  VOR  signal  1 

e.  Flying  straight  and  level  1 

f .  Flying  at  minimum  1 

controllable  airspeed 

g.  Performing  takeoff  and  1 

departure  stalls 

h.  Performing  approach  to  1 

landing  stalls 


I.  Performing  steep  turns  (720*)  1 

J.  Performing  accelerated  stalls  1 

k.  Performing  engine  failure  1 
during  flight  procedures 

l .  Performing  forced  landing  1 
procedures 


tasks. 

A 

A  SUBSTAN-  AN 

VERY  A  MODERATE  TIAL  EXTREME 

LITTLE  LITTLE  AMOUNT  AMOUNT  AMOUNT 

2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 
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A 

A  SUB STAN-  AN 

VERY  A  MODERATE  TIAL  EXTREME 
TASKS  NONE  LITTLE  LITTLE  AMOUNT  AMOUNT  AMOUNT 

m.  Performing  go-around  123456 

procedures 

n.  Flying  a  traffic  pattern  at  1  2  3  4  5  6 

an  uncontrolled  field 

o.  Making  a  normal  landing  at  1  2  3  4  5  6 

an  uncontrolled  field 

p.  Making  short- field  takeoffs  123456 
(uncontrolled  field) 

q.  Making  short-field  landings  123456 
(uncontrolled  field) 


r.  Making  soft  field  takeoffs  1 

(uncontrolled  field) 

s.  Making  crosswind  landings  1 

(uncontrolled  field) 

t.  Making  crosswind  takeoffs  1 

(uncontrolled  field) 

u.  Making  S  turns  across  a  road  1 

v •  Making  turns  about  a  point  1 

w.  Performing  a  rate  climb  1 

under  the  hood 

x.  Performing  a  magnetic  compass  1 
turn  under  the  hood 

y.  Performing  unusual  attitude  1 
recoveries  under  the  hood 

z.  Performing  180*  turns  under  1 
the  hood 

aa.  Flying  a  traffic  pattern  at  1 
a  controlled  field  (ACY) 

bb.  Making  a  normal  landing  at  1 
ACY 

cc.  Performing  all  radio  commu-  1 
nlcatlon  tasks 


2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 

2  3  4  5  6 
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APPENDIX  E 

PRE-  AND  POST-CHECK  QUESTIONNAIRES 


PHASE  CHECK:  III  IV 
(circle  one) 


STUDENT  PRE-CHECK  QUESTIONNAIRE 
Name:  Soc.  Sec.  Number: 


This  questionnaire  Is  part  of  the  overall  experiment  of  which  your  train¬ 
ing  Is  a  part.  Objective  data  concerning  your  flight  skills  are  being 
gathered  through  the  use  of  the  phase  checks  with  which  you  are  already  famil¬ 
iar.  The  purpose  of  this  questionnaire  Is  to  obtain  your  own  subjective 
assessment  of  your  skills.  This  assessment  will  be  compared  with  the  objec¬ 
tive  measures  obtained  during  the  phase  checks  and  with  subjective  ratings  you 
will  make  after  your  checkrlde  on  a  Post-Check  Questionnaire. 

The  data  obtained  from  these  questionnaires  will  aid  In  the  determination 
of  the  abilities  of  private  pilots  to  assess  their  own  skills.  Such  a  deter¬ 
mination  Is  of  great  Importance  since  general  aviation  pilots,  once  they  have 
received  their  certificates,  must  be  able  to  (1)  judge  If  they  can  perform 
certain  flight  tasks  safely,  (2)  assess  the  adequacy  with  which  they  accom¬ 
plish  tasks  they  do  perform,  and  (3)  determine  vtoen  they  need  refresher  or 
additional  training  to  Improve  their  skills.  Increased  understanding  of  the 
ability  of  general  aviation  pilots  to  make  these  Judgments  will  aid  In  deter¬ 
mining  how  to  prevent  accidents  from  happening  In  which  pilots  attempt 
maneuvers  that  are  beyond  their  skill  levels. 

None  of  the  Instructors,  Including  the  one  who  Is  administering  your 
checkrlde,  will  see  your  answers  to  this  or  the  Post-Check  Questionnaire. 
Please  be  frank  and  provide  honest  estimates  of  your  ability  to  perform  these 
tasks. 

Please  rate  your  ability  to  perform  the  following  tasks,  using  the 
7-polnt  scale  provided  next  to  each  task.  Descriptive  statements  for  scale 
points  1,  3,  S,  and  7  are  as  follows: 


1.  I  will  probably  be  able  to  perform  the  task  with  NO  ERRORS. 

3.  I  will  probably  make  a  FEW  ERRORS,  but  I  will  perform  the  task  well 
enough  to  pass  it  easily  on  my  checkrlde. 

5.  I  will  probably  make  SEVERAL  ERRORS  and  barely  pass  the  task  on  my 
checkrlde. 

7.  I  will  probably  make  MANY  ERRORS  and  be  unable  to  perform  the  task 
satisfactorily  on  my  checkrlde. 


E-2 


Circle  the  ntnsber  that  best  Indicates  how  well  you  will  perform  each  task  on 
the  checkrlde  you  are  about  to  take. 


TASKS 

1.  Planning  a  cross-country  trip 


NO 

ERRORS 
1 
1 


2.  Conducting  an  engine  run-up  and 
before  takeoff  check 

3.  Taking  off  and  departing  from  1 
ACY 

4.  Tracking  a  VOR  signal  1 

5.  Flying  straight  and  level  1 

6.  Flying  at  minimum  controllable  1 
airspeed 

7.  Performing  takeoff  and  departure  1 
stalls 

8.  Performing  approach  to  landing  1 
stalls 

9.  Performing  steep  turns  (720*)  1 

10.  Performing  accelerated  stalls  1 

11.  Performing  engine  failure  1 

during  flight  procedures 

12.  Performing  forced  landing  1 

procedures 

13.  Performing  go-around  procedures  1 

14.  Flying  a  traffic  pattern  at  an  1 

uncontrolled  field 

15.  Making  a  normal  landing  at  an  1 

uncontrolled  field 

16.  Making  short- field  takeoffs  1 

(uncontrolled  field) 

17.  Making  short-field  landings  1 

(uncontrolled  field) 


2 

2 


2 

2 

2 


2 

2 

2 


2 

2 

2 

2 


FEW  SEVERAL  MANY 

ERRORS  ERRORS  ERRORS 


3 

3 


3 

3 

3 


3 

3 

3 


4 

4 


4 

4 

4 


4 

4 

4 


5 

5 


5 

5 

5 


5 

5 

5 


6 

6 


6 

6 

6 


6 

6 

6 


7 

7 


7 

7 

7 


3  4  5  6  7 

3  4  5  6  7 
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TASKS 

NO 

ERRORS 

FEW 

ERRORS 

SEVERAL 

ERRORS 

MANY 

ERRORS 

18. 

Making  soft  field  takeoffs 
(uncontrolled  field) 

1 

2 

3 

4 

5 

6 

7 

19. 

Making  crosswind  landings 
(uncontrolled  field) 

1 

2 

3 

4 

5 

6 

7 

20. 

Making  crosswind  takeoffs 
(uncontrolled  field) 

1 

2 

3 

4 

5 

6 

7 

21. 

Making  S  turns  across  a  road 

1 

2 

3 

4 

5 

6 

7 

22. 

Making  turns  about  a  point 

1 

2 

3 

4 

5 

6 

7 

23. 

Performing  a  rate  climb  under 
the  hood 

1 

2 

3 

4 

5 

6 

7 

24. 

Performing  a  magnetic  compass 
turn  under  the  hood 

1 

2 

3 

4 

5 

6 

7 

25. 

Performing  unusual  attitude 
recoveries  under  the  hood 

1 

2 

3 

4 

5 

6 

7 

26. 

Performing  180°  turns  under  the 
hood 

1 

2 

3 

4 

5 

6 

7 

27. 

Flying  a  traffic  pattern  at  a 
controlled  field  (ACY) 

1 

2 

3 

4 

5 

6 

7 

28. 

Making  a  normal  landing  at  ACY 

1 

2 

3 

4 

5 

6 

7 

29. 

Performing  all  radio  communi¬ 
cation  tasks 
tasks 

1 

2 

3 

4 

S 

6 

7 
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PHASE  CHECK:  III  IV 
( circle  one) 


STUDENT  POST-CHECK  QUESTIONNAIRE 
Name:  Soc.  Sec.  Number: 


Now  that  you  have  taken  your  checkrlde,  please  rate  your  performance  on 
that  flight  on  the  following  tasks,  using  the  7-polnt  scale  beside  each  task. 
Descriptive  statements  for  scale  points  I,  3,  5,  and  7  are  as  follows: 

1.  I  performed  the  task  with  NO  ERRORS. 

3.  I  made  a  FEW  ERRORS,  but  probably  performed  the  task  well  enough  to 
pass  It  easily. 

5.  I  made  SEVERAL  ERRORS  and  probably  barely  passed  the  task. 


7.  I  made  MANY  ERRORS  and  probably  did  not  perform  the  task  satisfac¬ 
torily. 


Circle  the  number  that  best  Indicates  how  well  you  performed  each  of  the 
following  tasks. 


TASKS 


NO  FEW  SEVERAL  MANY 

ERRORS  ERRORS  ERRORS  ERRORS 


1.  Planning  a  cross-country  trip  1234567 

2.  Conducting  an  engine  run-up  1234567 

and  before  takeoff  check 

3.  Taking  off  and  departing  from  1234567 

ACY 


4.  Tracking  a  VOR  signal  123456 

5.  Flying  straight  and  level  1  2  3  4  5  6 

6.  Flying  at  minimum  controllable  1  2  3  4  5  6 

al rspeed 

7.  Performing  takeoff  and  departure  123456 
stalls 

6.  Performing  approach  to  landing  123456 
stal 1 s 

9.  Performing  steep  turns  { 720*)  123456 

10.  Performing  accelerated  stalls  1  2  3  4  5  6 


7 

7 

7 

7 

7 

7 

7 
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11. 

12. 

13. 

14. 

15. 

16. 

17. 

18. 

19. 

20. 

21. 

22. 

23. 

24. 

25. 

26. 

27. 

28. 
29. 


NO 

ERRORS 


Performing  engine  failure  1 

during  flight  procedures 

Performing  forced  landing  1 

procedures 

Performing  go- around  procedures  1 

Flying  a  traffic  pattern  at  an  1 

uncontrolled  field 

Making  a  normal  landing  at  an  1 

uncontrolled  field 


Making  short- field  takeoffs  1 

(uncontrolled  field) 

Making  short- field  landings  1 

(uncontrolled  field) 

Making  soft  field  takeoffs  1 

(uncontrolled  field) 

Making  crosswind  landings  1 

(uncontrolled  field) 

Making  crosswind  takeoffs  1 

(uncontrolled  field) 

Making  S  turns  across  a  road  1 

Making  turns  about  a  point  1 

Performing  a  rate  climb  under  1 

the  hood 

Performing  a  magnetic  compass  1 

turn  under  the  hood 

Performing  unusual  attitude  1 

recoveries  under  the  hood 

Performing  180*  turns  under  hood  l 

Flying  a  traffic  pattern  at  a  1 

controlled  field  (ACY) 


Making  a  normal  landing  at  ACY 

Performing  all  radio  communi¬ 
cation  tasks 


FEW 

ERRORS 
2  3 

2  3 

2  3 

2  3 

2  3 

2  3 

2  3 

2  3 

2  3 

2  3 

2  3 

2  3 

2  3 

2  3 

2  3 

2  3 

2  3 

2  3 

2  3 


SEVERAL 

ERRORS 

4  5 

4  5 

4  5 

4  5 

4  5 

4  5 

4  5 

4  5 

4  5 

4  5 

4  5 

4  5 

4  5 

4  5 

4  5 

4  5 

4  5 

4  5 

4  5 


MANY 

ERRORS 

6  7 

6  7 

6  7 

6  7 

6  7 

6  7 

6  7 

6  7 

6  7 

6  7 

6  7 

6  7 

6  7 

6  7 

6  7 

6  7 

6  7 

6  7 

6  7 
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APPENDIX  F 


INSTRUCTIONS  GIVEN  TO  THE  CHECKPILOTS  TO 
GUIDE  THEIR  USE  OF  THE  PPDR 


This  appendix  contains  the  handbook  that  was  used  as  a  reference  for  training 
the  checkpllots  to  use  the  PPDR.  The  PPDR  and  the  way  It  was  used  In  the 
study  are  described  In  the  Methods  section.  Appendix  C  contains  a  facsimile 
of  the  PPDR.  Training  of  the  checkpllots  Is  described  under  Procedure  In  the 
main  text. 
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Handbook 

Pilot  Performance  Description  Record  (PPDR) 


I .  Purpose 

A.  General  -  to  provide  a  method  of  clearly  describing  and  documenting 
student  pilot  performance. 

B.  Specific  -  to  provide  objective  performance  data  for  evaluating 
Contact  performance  of  students  In  various  training  tracks. 


II.  Guiding  Principles 

A.  To  obtain  a  maximum  of  descriptive  and  specific  judgmental  Infor¬ 
mation  with  a  minimum  of  Inflight  marking. 

B.  To  be  made  compatible  with  existing  FAA  and  E-RAU  checkrlde  proce¬ 
dures. 

C.  To  provide  a  snapshot  sample  of  student  performance  of  those  flying 
skills  required  for  Private  Pilot  Certification. 


III.  PPDR  Characteristics  and  General  Utilization 

A.  Each  flight  maneuver  In  this  PPDR  has  been  analyzed  and  discussed 
with  E-RAU  personnel  to  determine  Its  fundamental  components.  The 
analyses  provided  the  basis  for  the  development  of  descriptive  and 
judgmental  scales  on  which  each  performance  component,  such  as  direc¬ 
tion,  attitude,  power,  and  flight  path,  could  be  quickly  described  by 
the  checkpllot. 

B.  This  PPDR  Includes  a  sample  of  the  procedures  and  maneuvers  described 
In  the  FAA  flight  test  guide  on  which  proficiency  must  be  demon¬ 
strated  to  pass  the  checkrlde  for  Private  Pilot  certification.  This 
PPDR  Is  Intended  to  provide  descriptive  data  for  this  sample  only, 
and,  as  such,  It  should  be  viewed  as  a  part  of  the  checkrlde  and  not 
as  a  substitute  for  the  more  comprehensive  set  of  checkrlde  maneuvers 
prescribed  by  the  checkpllot.  Administration  of  this  PPDR  should  not 
restrict  or  constrain  the  checkpllot' s  usual  checkrlde  prerogatives. 
In  particular,  Inflight  safety  must  not  be  jeopardized.  The  sequence 
of  PPDR  maneuvers  should  be  standardized  as  described  In  E.  below. 

The  performance  description  resulting  from  this  PPDR  Is  considered  to 
be  as  complete  as  can  be  obtained  efficiently  by  manual  recording 
during  flight  periods. 

C.  In  any  data  collection  effort,  reliability  (meaning  consistency  or 
repeatability  of  test  result)  and  validity  (meaning  measurement  of 
that  which  Is  Intended  to  be  measured)  are  desirable  goals.  One 
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necessary  factor  In  achieving  high  levels  of  reliability  and  validity 
Is  standardization  of  the  test  sample,  test  conditions,  and  methods 
of  data  recording.  The  standardization  of  the  flight  test  sample  and 
the  methods  for  administering  and  evaluating  It  Is  the  aim  of  the 
PPOR. 

D.  This  PPOR  Is  separated  Into  four  sections,  one  for  each  phase  of  the 
private  pilot  certification  course.  The  four  phases  are  Phase  1, 
Presolo;  Phase  2,  Basic  Pilot  Operations;  Phase  3,  Cross-Country 
Flight  Operations;  and  Phase  4,  Private  Pilot  Operations.  Each  sec¬ 
tion  or  phase  check  consists  of  a  series  of  functional  context 
procedures/maneuvers  In  a  recommended  standardized  sequence  for 
recording.  Each  maneuver  Is  divided  Into  segments  that  specify 
observations  that  are  to  be  made  as  objectively  as  possible.  During 
a  flight  check,  student  performance  normally  Is  recorded  during  or 
near  the  end  of  each  maneuver  segment,  provided  that  performance  Is 
within  the  limits  specified  as  "proper"  on  all  scales  In  that 
segment.  Whenever  an  error  exceeding  "proper  limits"  of  a  scale 
occurs,  the  checkpllot  should  record  It  Immediately,  regardless  of 
how  much  of  the  segment  Is  completed.  If,  later  In  the  segment,  the 
student  exceeds  his  previous  error  on  the  same  scale,  the  checkpllot 
makes  a  second  mark  farther  out  on  the  scale.  Generally  speaking, 
erratic  performance  Is  reflected  by  multiple  marking:  for  example,  if 
the  descent  rate  during  an  approach  Is  uneven,  both  ''slow"  and  "fast" 
may  be  marked. 

E.  There  are  three  general  levels  of  detail  represented  In  the  PPDR: 

(1)  Individual  performance  measures,  (2)  flight  segments,  and  (3) 
maneuvers.  Segments  and  measures  are  listed  In  the  approximate 
sequence  In  which  they  occur  during  execution  of  the  maneuver.  This 
Is  Intended  to  simplify  and  standardize  inflight  data  recording. 

Individual  Performance  Measures.  The  PPDR  measuring  scales  show 
the  detailed  and  descriptive  criteria  of  student  performance  vrfilch 
underlie  the  evaluation  made  by  the  checkpllot.  Examples  of  these 
scales  are  RPM,  airspeed,  altitude,  and  ground  track.  These  scales 
are  recorded  objectively  by  the  checkpllot  from  Instruments  or 
clearly  definable  outside  references.  However,  It  Is  not  always 
possible  to  find  such  outside  references  for  certain  crucial  aspects 
of  student  performance.  Consequently,  a  few  scales  are  judgmental  In 
nature,  e.g.,  pattern  exit  or  control  smoothness.  The  checkpllot  must 
use  his  judgment  In  evaluating  and  recording  these  Items. 

Additionally,  to  assist  the  checkpllot  in  confirming  or  vali¬ 
dating  a  particular  procedure,  the  students  must  touch  or  move  the 
appropriate  Item  and  verbalize  the  procedures— e.g.,  during  preflight 
Inspection,  engine  start,  before  takeoff  procedures.  Verbalization 
of  procedures  also  serves  to  reinforce  student  learning. 

Flight  Segments.  The  subdivision  of  each  PPDR  flight  maneuver 
Into  Its  segments  Is  Indicated  by  single  horizontal  lines  between 
segments.  The  segment  breaks  serve  to  remind  the  checkpllot  of  the 
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time  required  for  that  particular  group  of  measures.  More  Impor¬ 
tantly,  they  make  it  easier  for  the  checkpilot  to  focus  on  a  particu¬ 
lar  group  of  measures  for  the  specific  portion  of  flight  performance 
being  recorded.  This  reduces  the  difficulty  In  determining  the 
flight  performance  sample  to  which  each  measure  applies.  Occasion¬ 
ally,  a  measure  refers  only  to  a  specific  part  (beginning  or  end)  of 
a  segment;  but  these  Instances  will  be  obvious  to  the  checkpilot. 
Segments  and  measures  are  sequenced  from  the  top  of  the  page  to  the 
bottom. 

Maneuvers .  There  are  several  factors  about  the  selected  flight 
maneuvers  that  the  PPOR  seeks  to  control.  One  factor  Is  the  specifi¬ 
cation  of  performance  measures  and  segments  within  maneuvers.  The 
PPOR  also  requires  that  all  students  perform  Identical  maneuvers, 
which  ensures  that  the  same  behavioral  patterns  are  sampled  In  all 
students.  Because  the  sequence  In  which  maneuvers  are  given  during  a 
flight  check  can  affect  the  results,  the  sequence  for  the  PPDR 
maneuvers  has  been  standardized.  The  sequence  vrfilch  has  been  settled 
upon  should  allow  for  maximum  use  of  available  time  and  resources. 

Due  to  the  requirement  for  economy  of  time  and  effort  In  conducting 
the  checkrlde,  the  performance  sequence  of  maneuvers  may  be  varied  to 
expedite  or  to  Increase  Its  efficiency  or  convenience.  However,  this 
standardized  sequence  should  be  followed  as  closely  as  possible.  All 
maneuvers  must  be  completed  for  each  checkrlde.  The  recommended 
sequence  for  the  Phase  I  (Presolo)  check  Is: 

1.  Preflight  Inspection  procedures 

2.  Engine  start 

3.  Taxiing  to  takeoff  position 

4.  Before  takeoff  procedures 

5.  Takeoff  and  departure 

6.  Turn  to  assigned  heading 

7.  Straight  and  level 

8.  Slow  fl  Ight 

9.  Takeoff  and  departure  stall 

10.  Approach  to  landing  stall 

11.  Engine  failure  during  flight 

12.  Before  landing  procedure 

13.  Traffic  pattern  (uncontrolled  field) 

14.  Landing  (uncontrolled  field) 

15.  Traffic  pattern  (controlled  field) 

16.  Landing  (controlled  field) 

17.  Taxiing  to  ramp 

18.  Securing  airplane  procedures 

F.  PPDR  reliability  Is  dependent  upon  the  degree  of  standardization 
achieved  In  administering  checkrides.  It  Is  essential  that  every 
checkpilot  thoroughly  understand  each  measure  In  this  PPDR  as 
described  In  this  appendix.  In  addition  to  knowing  the  measure  defi¬ 
nitions,  It  Is  Important  that  the  checkpilot  clearly  understand  that 
he  has  two  roles,  evaluator  and  recorder.  In  his  normal  role  as 
evaluator,  the  checkpilot  observes  student  perfonnance  throughout  the 
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entire  checkrlde,  and  renders  his  assessment  of  that  performance 
based  on  the  proficiency  that  he  observes.  As  a  recorder,  he  Is 
asked  to  provide  accurate  and  descriptive  Information  on  the  observed 
performance  as  It  occurs  and  upon  which  his  evaluation  Is  ultimately 
based.  The  recording  function  Is  thus  extremely  critical  to  the  PPDR 
data  collection  effort.  To  achieve  the  goal  of  accuracy  and  com¬ 
pleteness  of  recording,  the  student's  performance  should  be  recorded 
as  soon  after  It  occurs  as  Is  practical,  with  due  consideration  for 
safety. 

G.  The  checkpllot  should  maintain  an  Impartial  attitude  toward  the  stu¬ 
dent,  limiting  conversation  to  explaining  checkrlde  requirements  and 
conditions. 

H.  The  student  pilot  should  not  be  given  detailed  feedback  relative  to 
checkrlde  performance  prior  to  debriefing. 

I.  Measures  Included  In  this  PPDR  are  of  two  types: 

1.  Performance  Scales  with  a  desired  range  of  values  Indicated  by  a 
triangular  symbol  at  the  scale  midpoint,  and  errors  (e.g.,  left/ 
right),  to  either  side  of  the  triangle.  For  some  measures  a 
desired  value  Is  specified  at  the  top  of  the  triangle.  Other 
measures  Include  a  'O'  above  the  triangle,  Indicating  that  the 
checkpllot  must  determine  the  correct  desired  value  depending 
upon  the  aircraft,  airspace,  or  prevailing  conditions. 

2.  Categorical  Measures  (yes  or  no)  requiring  the  checkpllot  to 
determine  whether  or  not  the  observed  performance  Is  within 
acceptable  limits.  This  determination  Involves  more  complex 
judgment  for  some  measures  (e.g.,  constant  turn  radius)  than 
others  (e.g.,  full  throttle). 

J.  For  the  scale  measures  that  Include  a  specified  deviation  range 
(l.e.,  tolerance)  around  the  midpoint,  the  tolerance  band  specified 
may  or  may  not  be  Identical  to  the  standards  given  In  the  FAA  fl ight 
test  guide.  These  bands  are  not  necessarily  Intended  to  denote  FAA 
acceptable  performance,  but  rather  to  generate  accurate  data  to  docu¬ 
ment  observable  per fo nuance  differences. 

K.  This  version  of  the  PPDR  Is  not  Intended  for  use  In  diagnosing  stu¬ 
dent  performance  deficiencies.  However,  research  has  shown  that  use 
of  the  PPDR  can  lead  to  such  diagnosis  by  providing  Instructors  and 
training  managers  with  a  valid  and  reliable  performance  data  base 
describing  typical  and  atypical  student  performance.  These  data  may 
then  be  used  as  an  Index  of  comparison  (norm)  for  any  given  student’s 
observed  performance,  and  therefore  provide  effective  performance 
feedback  to  that  student. 
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IV.  PPOR  Data  Recording 


A.  The  cover  page  of  the  PPDR  Is  divided  Into  two  parts.  Part  One  con¬ 
tains  descriptive  Information  about  the  student,  checkpllot,  air¬ 
craft,  etc.  and  should  be  completed  In  Its  entirety  prior  to  the 
checkrlde.  Part  Two  contains  weather  data.  The  direction  and  velo¬ 
city  of  crosswind  as  well  as  existing  turbulence  should  be  recorded 
both  before  and  after  the  checkrlde. 

B.  Each  scale  should  be  marked  with  at  least  one  slash  mark  of  approxi¬ 
mately  1/4  Inch  In  length.  The  mark  should  pass  clearly  and  evenly 
through  the  scale  such  that  there  Is  no  doubt  about  which  scale  or 
which  portion  of  the  scale  the  checkpllot  Intended  to  mark.  Categor¬ 
ical  measures  should  Include  a  slash  mark  In  the  appropriate  box. 

C.  For  those  segments  encompassing  an  extended  period  of  time  (e.g., 
cllmbout  and  pattern  exit  after  takeoff),  multiple  marks  will  likely 
be  necessary.  This  gives  a  record  of  deviations  as  they  are  observed 
without  forcing  the  checkpllot  to  rely  upon  his  memory  of  an  extended 
performance  segment.  Errors  observed  In  both  directions  (e.g.,  low 
and  high)  should  be  appropriately  recorded.  Short  term  segments 
Te.g.,  flare)  should  Include  only  one  mark  for  each  measure. 
Requirement  for  multiple  marking  should  be  apparent  to  checkpllots. 

D.  If  dangerous  performance  occurs,  the  checkpllot  should  write  a  letter 
"D"  In  the  left  margin  and  draw  a  line  to  the  scale(s)  reflecting  the 
dangerous  performance.  If  a  maneuver  Is  aborted  because  of  student- 
induced  dangerous  performance,  an  additional  notation  should  be  made 
in  the  margin  and  all  remaining  measures  on  that  maneuver  marked  In 
error. 

E.  If  the  checkpllot  finds  It  necessary  to  assist  the  student  with  a 
maneuver,  "CP  Assist"  should  be  noted  In  the  margin  for  the  affected 
portion  of  the  maneuver  or  segment. 

F.  Go-arounds  and  their  reason  should  be  noted  In  the  margin.  When  a 
go-around  Is  Initiated  for  any  reason,  the  checkpllot  shall  note  the 
go-around  point  on  the  PPDR,  allow  one  additional  approach,  and  begin 
marking  at  the  point  of  go-around.  If  erratic  student  performance 
necessitates  a  second  go-around,  all  remaining  PPDR  measures  shall  be 
marked  In  error,  and  PPDR  recording  shall  terminate.  If  the  go- 
arounds  are.  In  the  judgment  of  the  checkpllot,  weather  or  traffic- 
induced,  a  notation  to  that  effect  should  be  made  In  the  margin,  and 
remaining  measures  left  unmarked. 

G.  The  checkpllot  should  write  any  additional  comments  that  he  deems 
pertinent  to  the  recorded  performance  data  In  the  spaces  provided  at 
the  bottom  of  each  maneuver  form.  He  may  also  write  to  the  side  of 
or  directly  above  measures  or  segments,  time  and  space  permitting. 
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APPENDIX  G 


STATISTICAL  ANALYSIS  PROCEDURES 


In  presenting  data  In  this  report,  several  types  of  statistics  are  used.  To 
summarize  the  general  nature  or  typical  value  for  a  group  of  measures, 
descriptive  statistics  such  as  the  Arithmetic  Mean  (M)  and  Standard  Deviation 
( SD )  are  used.  The  M  Is  that  statistic  which  Is  commonly  referred  to  as  "the 
average,"  while  the“^  Is  an  Indicator  of  the  degree  of  variability  among 
Individual  measures  about  the  group  M  value. 

In  evaluating  Aether  two  or  more  sets  of  data  (e.g..  Groups  A,  B,  and  C)  dif¬ 
fer  to  a  degree  greater  than  might  be  expected  by  chance,  various  statistical 
significance  tests  are  used.  In  the  present  report,  these  are  the  "t-test," 
"chi-squared"  test,  and  the  "analysis  of  variance  (ANOVA)." 

Degree  of  departure  from  chance  expectation  is  expressed  In  terms  of  probabil¬ 
ity  statements.  For  example,  the  expression  £  <  .05  means  that  the  probabil¬ 
ity  Is  less  than  5  In  100  that  the  difference  Is  due  to  chance  alone;  p  <  .01 
means  that  the  probability  Is  less  than  1  In  100;  etc.  Thus,  the  smaller  the 
probability  figure,  the  more  significant  a  difference  Is  and  the  less  likely 
it  Is  due  to  chance  variation.  In  keeping  with  statistical  convention,  dif¬ 
ferences  are  not  considered  statistically  significant  here  unless  the  proba¬ 
bility  Is  5  In  100  or  less. 

The  ANOVA  test  yields  a  statistic  called  the  £  ratio,  which  Is  the  ratio  of 
two  variance  estimates,  and  It  Is  this  £  statistic  that  allows  the  probability 
determination.  Similarly,  the  t-test  and  chi-squared  test  yield  statistics 
that  permit  a  probability  determination  of  the  significance  of  a  difference. 
In  all  of  these  tests,  reference  Is  made  to  df,  or  degrees  of  freedom.  The  df 
refers  basically  to  the  number  of  independent  measures  on  vrtilch  the  test  Ts 
based. 

The  manner  and  degree  to  which  two  factors  are  related  Is  expressed  by  the 
Pearson  product-moment  correlation  coefficient  (£) .  The  value  of  jr  can  be 
positive  (+),  Indicating  a  tendency  for  the  two  variables  to  Increase  together 
or  decrease  together,  or  It  can  be  negative  (-),  indicating  that  as  one 
variable  Increases,  the  other  tends  to  decrease,  or  vice  versa.  The  numerical 
value  of  jr  can  range  from  +1.00  to  -1.00.  An  jr  value  of  0.00  Indicates  no 
correlation  between  the  two  variables. 

The  reader  desiring  more  Information  of  such  statistical  analysis  and  test 
procedures  Is  referred  to  any  one  of  the  large  nunber  of  standard  statistical 
textbooks  available.  For  example,  see: 

Edwards,  A.  L.  Statistical  analysis.  New  York:  Holt,  Rinehart,  A  Winston, 
1974. 

McNemar,  Q.  Psychological  statistics.  New  York:  John  Wiley  A  Sons,  1969. 

Runyan,  R.  P. ,  A  Haber,  A.  Fundamentals  of  behavioral  statistics.  Reading, 
MA:  Addlson-Wesley,  197H 
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